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Abstract — Handling interference is one of the main 
cliallenges in tlie design of wireless networks. One of 
the key approaches to interference management is node 
cooperation, which can be classified into two main types: 
relaying and feedback. In this work we consider simultane- 
ous application of both cooperation types in the presence 
of interference. We obtain exact characterization of the 
capacity regions for Rayleigh fading and phase fading 
interference channels with a relay and with feedback 
links, in the strong and very strong interference regimes. 
Four feedback configurations are considered: (1) feedback 
from both receivers to the relay, (2) feedback from each 
receiver to the relay and to one of the transmitters (either 
corresponding or opposite), (3) feedback from one of the 
receivers to the relay, (4) feedback from one of the receivers 
to the relay and to one of the transmitters. Our results 
show that there is a strong motivation for incorporating 
relaying and feedback into wireless networks. 



I. Introduction 

Communication in the presence of interference is one 
of the main areas of research in information theory. The 
most basic network in which there is interference is the 
interference channel (IC), introduced by Shannon in yj. 
The IC consists of two transmitter-receiver pairs, Tx^- 
Rxfc, k G {1,2}, sharing the same physical channel. 
The very strong interference (VSI) regime was tirst 
characterized for ICs by Carleial in [2|. When VSI 
occurs in ICs, each receiver can decode the interference 
by treating its own signal as noise, without limiting the 
rate of the other pair. Thus, each pair can communicate 
at a rate equal to its point-to-point (PtP) interference- 
free capacity. A weaker notion called strong interference 
(SI) was introduced by Sato in When SI occurs in 
ICs, each receiver can decode both messages without 
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reducing the capacity region of the IC. In |3] Sato 
showed that in such a scenario the capacity region of 
the IC is given by the intersection of the capacity regions 
of two multiple-access channels (MACs) - derived from 
the IC. The capacity region of the scenario where both 
messages are required by both receivers was first derived 
by Ahlswede in [4|. 

One of the key approaches to interference manage- 
ment in wireless networks is relaying. The relay channel 
was first introduced by van der Meulen in IH and it 
consists of three nodes - a transmitter, a receiver, and 
a relay, which assists the communication between the 
transmitter and the receiver In @ Cover and El Gamal 
derived an achievable rate for the relay channel by 
using a superposition block-Markov codebook and by 
decoding the source message at the relay. The relay then 
sends a message that assists the decoder resolve the 
uncertainty about the source message. This scheme is 
called decode-and-forward (DF). Another fundamental 
scheme introduced in [6 ] is based on compression at the 
relay. This scheme is commonly referred to as compress- 
and-forward (CF). In addition. Cover and El Gamal 
provided an outer bound on the capacity of a general 
relay channel, but the exact capacity remains unknown. 
An important contribution to the study of relay networks 
is the work of Kramer et al. in |7 |. Kramer et al. obtained 
capacity theorems as well as achievable rate regions 
for different relay networks by using the DF and CF 
strategies. In Q, capacity results were presented for 
several relay networks for phase fading and Rayleigh 
fading channel models. 

The classic relay channel of 161 can be extended by 
adding a second source node, such that (s.t.) the relay 
assists the communications from both sources to the (sin- 
gle) destination. This model is called the multiple-access 
relay channel (MARC). Some capacity results as well as 
inner and outer bounds for the white Gaussian MARC 
were derived by Kramer et al. in |8]. The capacity region 
of the phase fading MARC was characterized in [7|. 
Sankaranarayanan et al. presented outer bounds on the 
capacity region as well as achievable rate regions for 
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the MARC in [9|. The sum-capacity of the degraded 
Gaussian MARCj^ was studied by Sankar in [10|. In 
|[Tp| it was shown that while in the relay channel the 
degradedness assumption simplified the cut-set bound 
to coincide with the DF achievable rate region, in the 
MARC this is not the case. The MARC model can be 
generalized by considering multiple relays. The relay 
nodes are said to be parallel if there is no direct link 
between them, while all source-relay, relay-destination 
and source-destination links exist. The parallel Gaussian 
MARC, with the relay nodes using the amplify-and- 
forwar^ (AF) strategy, was studied by del Coso et al. 
in dl- 

The MARC can be further extended by adding a sec- 
ond destination node s.t. each transmitter communicates 
only with a single destination. This gives rise to the 
interference channel with a relay (ICR) which consists 
of five nodes. This channel was first studied by Sahin 
and Erkip [12] and has gained considerable interest in 
the past few years. Inner bounds as well as outer bounds 
on the capacity region were derived for the ICR, see 
ifBl . El, US'! and fTFl and the references therein. 
One of the critical aspects in the study of ICRs is to 
determine what is the best strategy for the relay, since 
when assisting one receiver the relay may degrade the 
performance of the other receiver. Moreover, in some 
situations the optimal relay strategy would be to forward 
interference rather than desired information |14]. Thus, 
there might not be one scheme which increases the 
achievable rates for both pairs simultaneously. In f5l\ 
it was shown that when the relay is cognitive then it is 
able to assist both pairs simultaneously by simultane- 
ously zero-forcing the interference at each receiver. This 
assistance was shown to be optimal from the degrees-of- 
freedom (DoF) perspective for a large range of channel 
coefficients. The capacity region of fading ICRs for a 
non-degraded scenario with a causal relay and finite 
signal-to-noise ratios on all links, was first characterized 
in ifTTll and ifTSll . In these works it was shown that in 
some situations the best strategy for the relay is DF 
and that the relay can optimally assist both receivers 
simultaneously, from the capacity perspective. Lastly, 
global, instantaneous CSI was considered in [59] . In the 
work [59!], fading ICRs with an "on-and-off ' relay were 
studied. Under the assumption of using "asynchronous 
relaying" (i.e., the codebooks of the sources and of the 

'a K-user Gaussian MARC is said to be degraded if, given the 
transmitted signal at the relay, the multiaccess signal received at the 
destination is a noisier version of the multiaccess signal received at 
the relay. 

^In amplify-and-forward the relay simply transmits a scaled version 
of its receives signal. 



relay are mutually independent) and with the assumption 
that the fading coefficient equals zero with a positive 
probability, [59] obtained an achievable rate region. 

Another tool for handling interference in wireless net- 
works is feedback from receiving nodes to transmitting 
nodes. Feedback allows the nodes to coordinate their 
transmissions and thereby sometimes helps in achieving 
higher rates compared to those achieved without coor- 
dination. In 1.19.1 Shannon showed that feedback does 
not increase the capacity of memoryless PtP channels. 
However, in ll20l Gaarder and Wolf showed that in a 
memoryless MAC, if both transmitters have feedback 
from the receiver, they can cooperate to increase the 
capacity region. This was the first time it was shown 
that feedback increases the capacity region of a mem- 
oryless channel. In [6| Cover and El Gamal showed 
that the cut-set bound for the relay channel is achieved 
with DF when feedback is available at the relay. In 
such a scenario feedback to the transmitter does not 
provide further improvement onto feedback to the relay. 
Additional results on the achievable rates in the relay 
channel with receiver-transmitter feedback were obtained 
in [21 J. For the MARC with feedback from the relay 
to the sources, Hou et al. derived an outer bound on 
the capacity region as well as achievable rate regions in 
li22l . In II22I feedback was used to allow each source 
to decode the message of the other source, thereby the 
transmitters could cooperate and resolve the uncertainty 
at the receiver. The MARC with generalized feedback 
(MARC-GF) was studied by Ho et al. in [23|. The 
MARC-GF models cellular networks in which all the 
mobile stations can listen to the ongoing transmissions 
through the channel. 

Feedback was also studied for ICs. In |[24l it was 
shown that for interference channels at SI, the capacity 
region is enlarged if each transmitter receives feedback 
from the receiver to which it is sending messages. 
The sum-capacity of symmetric deterministic ICs with 
infinite-capacity feedback links from the receivers to the 
transmitters, was studied by Sahai et al. in [23- In ll25l 
it was shown that having a single feedback link from one 
of the receivers to its own transmitter results in the same 
sum-capacity as having a total of four feedback links - 
from both receivers to both transmitters. fl5 \ also consid- 
ered a practical feedback configuration for a TDD based 
system, where the forward and the feedback channels 
are symmetric and time-shared and it was shown that 
in such a scenario, feedback does not increase the sum 
capacity of the IC in the SI regime. In [5U Cadambe and 
Jafar provided a tight characterization of the generalized 
degrees-of-freedom (GDoF) for ICs with feedback for 
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values of a = i^gSNR — §■ ^'^ observed in lISTI 
that feedback leads to an unbounded capacity gain in 
the very strong interference regime (q > 2). In |26] the 
capacity region of the Gaussian IC with feedback was 
characterized to within 2 bits/symbol/Hz, and the exact 
GDoF was characterized for all values of a. In particular, 
it was shown in [26 1 that feedback provides a capacity 
gain that increases with the SNR to infinity also in the 
weak interference regime (0 < a < |), in addition to the 
case a > 2. In fZl] an achievable rate region for ICs with 
generalized feedback was derived. In this scenario, each 
transmitter observes outputs from the channel, thereby 
allowing the transmitters to cooperate and achieve higher 
rates compared to the no-feedback scenario. The effect 
of finite-capacity feedback Unks on the capacity region 
of ICs was also studied in recent works. The work of ll54l 
considered the effect of rate limited feedback on the ICs. 
In [|54] . communication schemes, based on sending to the 
transmitter partial information on the interfering signal, 
were developed. The paper ll54l presented a constant-gap 
result for Gaussian ICs with rate-limited feedback and 
a tight characterization for linear deterministic ICs. In 
||55J the effect of noisy feedback on the capacity region 
of Gaussian ICs was considered. For the situation in 
which both transmitters observe noisy feedback from 
both receivers, it was shown that feedback looses its 
value when the noise in the feedback signal is of the 
same variance as the noise in the direct link. Finally, 
note that generalized feedback (or, equivalently source 
cooperation), studied in |27|, |56|, and |57| can also 
considered rate-limited feedback when the SNR is finite. 
In ll56l and ll57l outer bounds were derived for ICs with 
generalized feedback. 

The impact of both relaying and feedback on the 
DoF of interference channels was studied in ll53ll . The 
work li53l considered a network with multiple sources, 
multiple relays and multiple destinations, in which the 
channel coefficients are random time-varying/frequency- 
selective and all channel coefficients are known a-priori 
at all nodes. For such a scenario, ||53l showed that 
relays and feedback (and even noisy cooperation between 
the destinations and the sources) do not provide higher 
total DoF than that obtained without such techniques. 
However, the impact of the combination of relaying and 
feedback on the capacity of ICs at finite SNRs has not yet 
been characterized. In this work we study the capacity of 
full-duplex fading interference channel with a relay and 
with different feedback configurations. We consider the 
channel when it is subject to phase fading and Rayleigh 
fading. The phase fading model is mostly applicable to 
high-speed microwave communications, in which phase 
noise is generated by the oscillators or due to the 



lack of synchronization. The phase fading model also 
applies to orthogonal frequency division multiplexing 
(OFDM) 1 28 1, as well as to some applications of naval 
communications. Rayleigh fading models are commonly 
used in wireless communications and apply to scenarios 
in which the multipath effect is not negligible, e.g., dense 
urban environments [ 29 1 - 

Main Contributions 

In this paper we present the first investigation of the 
application of both relaying and feedback to interference 
channels. We provide capacity characterization for the 
fading interference channel with a relay and feedback 
links (ICRF), in the SI and VSI regimes. We assume 
only receiver channel state information (Rx-CSI). All 
capacity regions obtained in this work are derived under 
the assumptions that the fading channel coefficients are 
mutually independent and i.i.d. in time, and that the 
phase of each fading coefficient is uniformly distributed 
over [0,27r), and is independent of its magnitude. Ex- 
plicit capacity regions are given for two fading models: 
phase fading and Rayleigh fading, which are special 
cases of this general model. 

• We first characterize the capacity regions of ICRFs 
in which both receivers send (noiseless) causal 
feedback only to the relay, for VSI and SI regimes. 

• Next, we consider the case where feedback is also 
available at the transmitters to determine whether 
the transmitters can exploit this additional informa- 
tion to cooperate and enlarge the capacity region 
compared to the first configuration. The answer to 
this question is not immediate since the availability 
of feedback at the transmitters can enlarge the 
capacity region of MACs and ICs, but for the relay 
channel it does not provide any improvement once 
feedback is available at the relay. 

• We then study the performance when feedback 
is available only from one of the receivers and 
examine whether the performance degradation is the 
same for both pairs. Capacity results are provided 
for this scenario as well. 

Identifying optimal strategies for ICRFs has a direct im- 
pact on the design of future wireless networks in which 
interference is a critical issue. These implications will be 
highlighted throughout. Some important consequences 
of our results include a proof that a single relay can 
be optimal simultaneously for two separate Tx-Rx pairs 
as well as the maximum performance gains that can be 
obtained in different feedback configurations. To the best 
of our knowledge these are the first capacity results for 
ICs with relaying and feedback. 
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The rest of this paper is organized as follows: in sec- 
tion [n] we define the system model. In section III several 
frequently used lemmas and theorems are provided. In 
IV and |V] we provide an exact characterization 



sections 



of the capacity regions of ICRFs with feedback from 
both receivers to the relay, in the VSI and SI regimes. 
We also provide explicit expressions for the phase fading 
and Rayleigh fading model^ In section VI we analyze 



the scenario in which feedback is available both at the 



relay and at the transmitters. In section [VII] we consider 
the case in which partial feedback (only from one of 
the receivers) is available at the relay. For this scenario, 
we characterize the capacity regions in the VSI and SI 
regimes and provide explicit expressions for the phase 
fading and Rayleigh fading models. Finally, in section 



VIII we present concluding remarks. 



II. Notations and Channel Model 

We denote random variables (RVs) with capital letters, 
e.g., X, Y and their realizations with lower case letters, 
e.g., X, y. We denote the probability density function 
(p.d.f.) of a continuous RV X with fx{x). Capital 
double-stroke letters are used for matrices, e.g.. A, 
with the exception that E{X} denotes the stochastic 
expectation of X. Vectors are denoted with bold-face 
letters, e.g., x and the i'th element of a vector x is 
denoted with Xj. We use x| where i < j to denote the 
vector (xj, Xj+i, Xj). X* denotes the conjugate 
of X and denotes the Hermitian transpose of A. 
Given two n x n Hermitian matrices. A, B, we write 
B ^ A if A — B is positive semidefinite (p.s.d.) and 
B -< A if A - B is positive definite (p.d.). A^"^(X,y) 
denotes the set of weakly jointly typical sequences 
with respect to /x,y(x,2/), as defined in ||39l Sec. 8.2]. 
We denote with the empty set. Finally, we denote 
the Normal distribution with mean /i and variance o"^ 
with A/'(/x, o"^), and the circularly symmetric, complex 
Normal distribution with mean fi and variance o"^ with 
CAA(/i,a2). 

In the interference channel with a relay there are two 
transmitters and two receivers. Txi wants to send a 
message to Rxi and Tx2 wants to send a message to 
Rx2. The received signals at Rxi, Rx2 and the relay at 
time i are denoted by li j, ¥2^1, Y^^i respectively. The 
channel inputs from Txi, Tx2 and the relay at time i 
are denoted by j, X2^i and Xs.j, respectively. The 
relationship between the channel inputs and its outputs 



For the Rayleigh fading, the expressions include integrations 
which can be evaluated numerically in a simple manner. 




Fig. 1: The interference channel with a relay and with 
feedback from both receivers to the relay. The 'D' block 
represents a single-symbol delay. 

is given by: 

Yi,i = Hii^iXi^i + H2i,iX2,i + Hsi^iX^^i + Zi^i (la) 

Y2,i = Hi2^iXii + H22,iX2,i + Hs2,iXs^i + Z2,i (lb) 
Y3,i = Hi3^iXi^i + H2Z,iX2,i + Z'i^i, (Ic) 

i = 1,2, where Zi, Z2 and Z3 are mutually inde- 
pendent, zero-mean, circularly symmetric complex Nor- 
mal RVs, CA/'(0, 1), independent in time and independent 
of the channel inputs and the channel coefficients. The 
channel input signals are subject to per-symbol average 
power constraints: E{|Xfcp} < Pk, k e {1,2,3}. The 
channel coefficients Hik^i are mutually independent and 
i.i.d. in time. The magnitude and phase of Hik i are 
independent RVs, and the phase is uniformly distributed 
over [0, 2n). 

Throughout this paper channel state information (CSI) 
at the receivers is assumed. We represent the CSI at 
receiver k with Hk = (i^ifc, i?2fc, ^^sfc), k G {1,2}. 
As each element in Hk is a complex scalar random 
variable, then Hf^ S For consistency of notations 
we use S)k to denote the space of the random vector 
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and 



we assume 



Hk, thus S^k = In sections 
noiseless feedback links from both receivers to the relay, 
s.t. the channel outputs y\~i , y2~i' and the corresponding 
Rx-CSIs, h'^j^^ and hlf^, are available at the relay at 
time i prior to transmission. This model is described in 
Fig. [T] Hence, the CSI at the relay is represented by 
H = {Hij, H23, Hi, H2) G We denote the space of 

H with ^ = e:^. 

Comment 1. Note that as feedback contains both chan- 
nel output and Rx-CSI, feedback from both receivers 
to the relay, leads to the relay having delayed Tx- 
CSI on its outgoing links. In this work we will show 
that as the channel is memoryless and the coefficients 
are i.i.d. with uniformly distributed phases, independent 
of their magnitudes, such feedback does not result in 
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correlated channel inputs. Note that destinations-relay 
feedback which includes Rx-CSI leads to the conclusion 
that reliable decoding at the destinations guarantees 
reliable decoding at the relay. This, in turn, leads to the 
optimality of DF in SI and VSI. Without including Rx- 
CSI in the feedback signal, then, in order to achieve such 
an implication, it is necessary to impose restrictions on 
the channel coefficients. This decreases the set of channel 
coefficients for which we can achieve the capacity region 
of the ICRF by using DF at the relay. This will be 



In sections fVll and IVIIl the definitions of Rx-CSI and 



elaborated upon in Comment 10 



Comment 2. We note that an important problem is 
the case of global instantaneous CSI. In such a case, 
following the approach in ||59l and |[60l . the fading 
channel is decomposed into parallel Gaussian ICRs. 
However, for such channels it is not possible to use the 
techniques of the current work to show that mutually 
independent channel inputs maximize the cut-set bound. 
This is because the channel coefficients and channel 
inputs at the same time instant can be correlated, and 
therefore the nodes can use the CSI to achieve correlation 
between their signals. The case of global instantaneous 
CSI will not be treated in the current manuscript. 

We now define the code, probability of error, achiev- 
able rates, and capacity region: 

Definition 1. An {Ri,R2,n) code for the ICRF, de- 
picted in Fig. [l| consists of two message sets Aik — 
{l, 2, 2"^*=}, k E {1, 2}, two encoders at the sources, 
61,62, and two decoders at the destinations, 51,52; 
ek : Mk ^ C", fffe : .51? X e:" Mk, k G {1,2}. 
At the relay there is a causal encoder. Since in sections 
Irvl and |V] feedback from both receivers is available at 
the relay, then the encoded signal at the relay is a causal 
function of the channel outputs at the receivers, its own 
received symbols and the corresponding Rx-CSIs, i.e.. 



X3,i 



, / t— 1 4—1 *— 1 A*^-'^ h''^'^\ a fT 

)i/2,l ' ^3,1 ' '''13,1' '^23,1' '^l,! ''''2,1 j ^ *-' 



(2) 



1,2, 



Definition 2. The average probability of error is defined 

as pi") ^ Pr(5i(i7f,y-) / Ml or 52(^2"' ^2") / 
M2) , where M\ and M2 are selected independently and 
uniformly over their message sets. 

Definition 3. A rate pair (i?i, R2) is called achievable if 
for any e > and (5 > there exists some block length 
no(e,(5) s.t. for every integer n > nQ{e,6) there exists 
an {Ri — 6, R2 — 6, n) code with < e. 

Definition 4. The capacity region is defined as the 
convex hull of all achievable rate pairs. 



the code will be specialized according to the feedback 
configurations of these sections. 

In this paper we also present explicit capacity ex- 
pressions for phase fading and Rayleigh fading models, 
which are two fading models that satisfy the general 
fading model defined above. These models are defined 
as follows: 

• Piiase fading channels: The channel coefficients 

are given by Hik^i = aikC^'^"-'', aik G 9^+ are non- 
negative constants corresponding to the attenuation 
of the signal power from node I to node k, and B/^ j 
are uniformly distributed over [0,27r), independent 
in time and independent of each other and of the 
additive noises Zk, k G {1,2,3}. 

• Rayleigii fading cliannels: The channel coefficients 
are given by Hik^i = aikUik^i , aik G ^+ are non- 
negative constants corresponding to the attenuation 
of the signal power from node / to node k, and 
Uik,i are circularly symmetric, complex Normal 
RVs, Uik.i ~ CJ\f{0, 1), independent in time and 
independent of each other and of the additive noises 
Zk, k G {1,2,3}. 

III. Preliminaries 

In this section we present some of the frequently used 
lemmas. 

A. Maximum Entropy for Complex Random Vectors 

Lemma 1. Consider a complex random vector, X = 
(Xi,X2). Let X' = (X;,X'2) = X - E{X}. Then 

/i(x;|x'2) = /i(Xi|X2). 

Proof: The proof follows directly from the defini- 
tion of the differential entropy. ■ 

Lemma 2. Let Xi , X2 , Xk be an arbitrary set of k 
zero-mean complex random variables with covariance 
matrix K. Let S be any subset of n elements from 
{1, 2, fc} and be its complement. Then: 



/i(X5|X5c) < log (^(7r6)"det (cov(X5|X5c))j, 

with equality if and only if Xi,X2, ■■■,Xk ~ CAA(0, K). 

Proof: The proof follows along the Unes of the proof 
of [|491 Lemma 1] and an application of ll34l Theorem 
1] and (Ml Theorem 2]. ■ 



B. The Positive Semidefinite Ordering 

Lemma ( ll46l Lemma 3.1]). Let Xi and X2 be random 
vectors with zero mean and covariance matrices Gmk = 
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E{X,^Xf }, m, k E {1, 2}. Define: A ^ C^^^ •Ci2-C22^ 
Then there exists p £ [0, 1] s.t. 

I - AA" ^ (1 - 



C. Joint Typicality 

Lemma (||6l Lemma 2]). Let (81,82,83) ~ 
]Ji=iP{si,i,S2,i,S3,i) and (81,82,83) ~ UA=iPis3,i)x 
Pisi,i\s3,i)pis2,i\s3,i)- Then for n s.t. 
Pr {A'^iSi, 82, 83)} > 1 - e, it holds that: 

Pr{(8'i,S'2,S3)G4"^(8i,82,83)} 

^ 2-n{l{SuS2\S3)-7e) 

D. The Capacity of Phase Fading and of Rayleigh 
Fading MIMO Relay Channels 

We now state a slight variation of Q Theorem. 8] 
which will be used in this paper: 

Theorem (fJ\ Theorem. 8]). For phase fading and for 
Rayleigh fading relay channels with multiple antennas, 
and with Rx-CSI available, the channel inputs Xi and 
X3 that maximize both the cut-set bound. 



max mill {l(Xi ; Fi , y3 1 ^3 , i^ii , ^31 , ^13) , 

I{Xi,X3;Yi\Hn,H3i)}, 

and the DF rate, maxp(^^ -j^^) min |/(Xi; IsjXs, ifi3), 
/(Xi, X3; ^117711,7^31)}, are independent complex Nor- 
mal variables. The best covariance matrix for transmitter 
Txt is = ^J^lnt, t = 1,2, where 1^^ is the 

nt X nt identity matrix. DF achieves capacity if its rate 
is I(Xi, X^'jYi). The capacity is then given by 



'fading relay 



f{hr,i)loi 



hrA 



I«i + Oil — hiihii 
rii 



+031~^31^31 



dhj- 



where h-j-,! = {/iii,/i3i}. 



IV. ICRFs IN THE Very Strong Interference 
Regime 

In this section, we consider the ICRF with two noise- 
less feedback links from the receivers to the relay (see 
Fig. [T]l and we characterize the capacity region of ICRFs 
in the VSI regime. This result is stated in the following 
theorem: 

Theorem 1. Consider the fading ICRF with Rx-CSI. 
Assume that the channel coefficients are independent 
in time and independent of each other s. t. their phases 



are i.i.d. and distributed uniformly over [0, 27r). Let the 
additive noises be i.i.d. circularly symmetric complex 
Normal processes, CM{0, 1), and let the sources have 
power constraints E{|Xfcp} < P^, k € {1,2,3}. 
Assume noiseless feedback links from both receivers to 
the relay (see Fig. [7]). If 

I{Xi,X3;Yi\X2,Hi) < I{Xi-Y2\H2) (3a) 
I{X2,X3;Y2\Xi,H2) < I{X2]Yi\Hi), (3b) 

where the mutual information expressions are evaluated 
with Xk ~ CJ\f{0,Pk),k € {1,2,3}, mutually inde- 
pendent, then the capacity region is given by all the 
nonnegative rate pairs s.t. 

< I{Xi,X3;Yi\X2,Hi) (4a) 
R2 < I{X2,X3;Y2\Xi,H2), (4b) 

and it is achieved with X^ ~ CM{0, Pk), k G {1, 2, 3}, 
mutually independent and with DF strategy at the relay. 



A. Proof of Theorem [7] 

The proof consists of the following steps: 

• We obtain an outer bound on the capacity region 
using the cut-set bound. 

• We show that the input distribution that maximizes 
the outer bound is zero-mean, circularly symmetric 
complex Normal with channel inputs independent 
of each other and with maximum allowed power. 

• We derive an achievable rate region based on DF 
at the relay and by using mutually independent 
codebooks generated according to the zero-mean, 
circularly symmetric complex Normal input distri- 
bution: 

- We derive an achievable rate region for decod- 
ing at the relay using steps similar to Q Sec. 
4.D]. 

- We obtain an achievable rate region for de- 
coding at the destination by decoding the in- 
terference first, while treating the relay signal 
and the desired signal as additive i.i.d. noises, 
followed by using a backward decoding scheme 
for decoding the desired message. 

• We derive the VSI conditions which guarantee that 
decoding the interference first at each receiver, does 
not constrain the rate of the other pair. 

• We conclude that when the VSI conditions hold the 
achievable region coincides with the cut-set bound. 



These steps are elaborated in sections |IV-A1[ |IV-A2| and 
II V- A3 1 
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1) An Outer Bound: The cut-set theorem |[39l Theo- 
rem 15.10.1] applied to the ICRF results in the following 
upper bounds: 

S = {Txi},cS^ ^ {Tx2, Relay, Rxi,Rx2} : 

Ri < I{Xi-Yi,Y2,Y^\X2^X^,H) (5a) 
S = {Txi,Relay,Rx2},5^ = {Tx2,Rxi} : 

i?i </(Xi,X3;li|X2,i?i) (5b) 
S = {Tx2},5^ = {Txi, Relay, Rxi,Rx2} : 

R2 < IiX2;Yi,Y2,Y3\Xi,X3,H) (5c) 
S = {Tx2,Relay,Rxi},5^ ^ {Txi,Rx2} : 

R2<I{X2,X3;Y2\Xi,H2) (5d) 
S = {Txi,Tx2},cS^ = {Rxi,Rx2, Relay} : 

Ri + R2< I{Xi,X2;Yi,Y2,Y3\X3,H).{5e) 

Next, we find the channel input distribution that maxi- 
mizes the cut-set bound. We follow the same approach 
as in \Jj Proposition 2] and [7, Theorem 8]. Let X 
denote the channel inputs with the maximizing distri- 
bution. Note that Lemma [T] states that the zero-mean 
complex random vector X' = X — E{X} has the same 
entropy as X. Hence, the most efficient strategy would 
be to transmit X' rather than X, since subtracting the 
average reduces the power consumption. Using the steps 
detailed in Appendix [Aj we conclude that each mutual 
information expression in (|5]) is maximized by (zero- 
mean) circularly symmetric complex Normal channel 
inputs, independent of each other, and with the sources 
transmitting at their maximum available power even 
though the scenario consists of a combination of relaying 
and feedback. 

Comment 3. Note that this conclusion is not immediate 
from Q Theorem 8], since in the ICRF there are two 
destinations, while the cut-set bound in fT', Theorem 8] 
considers only one destination and T transmitting relays. 
Hence, the conditional entropies in the present case con- 
tain more complicated combinations of the correlation 
coefficients between the channel inputs and thus each 
expression needs to be examined individually. 

Comment 4. Note that although the cut-set bound of 
the ICRF scenario requires maximization over all in- 
put distributions of the type /(xi)/(a;2)/(a:;3|xi, 2;2), in 
Appendix [A| it is shown that /(x3|xi,X2) = f{xz) is 
the maximizing distribution at the relay, and that the 
input distribution is jointly Gaussian (as follows from 
||7l Proposition 2]). The intuition behind the mathemat- 
ical result is that as receivers have Rx-CSI, then the 
mutual information expressions involve averaging over 
all channel coefficients. However, as the phases are all 
uniformly distributed over [0, 2it), it follows that for any 



cross-correlation structure between the channel inputs, 
the same rate bounds can be obtained by the negative 
cross-correlation. Thus the maximum rate is achieved 
when the cross-correlations are equal to their negatives, 
and are therefore zero. As the maximizing distribution is 
uncorrelated Gaussians, they are also independent. This 
also reflects the fact that due to the i.i.d. uniform phase 
of the fading process, it is not possible to correlate the 
channel codewords of the different transmitting nodes, 
leading, due to Gaussianity, to independence. 

2) An Achievable Rate Region: Now we obtain 
an achievable rate region using the input distribu- 
tion that maximizes the cut- set bound in Q. The 
achievability is based on DF strategy at the re- 
lay. Fix the blocklength n and the input distribution 

fx^,X^,xAxi,X2,X'i) = fxAxi) ■ fxAx2) ' fx^^s) 

where fxkixk) ~ CAf{0, Pk),k = 1,2,3. Consider the 
following coding scheme, in which B — 1 messages are 
transmitted using nB channel symbols: 

a) Code Construction: For each message mk S 
A4k,k £ {1,2} select a codeword Xfc(mfc) according 
to the p.d.f. /x,(xA:(mfc)) = YYi=i fx,{xk,i{'^k)) ■ 
For each (mi, 7112) G M-i x A42 select a codeword 
X3(mi,m2) according to the p.d.f. (x3(mi, m2)) = 
117=1 fxs (2;3,i(mi,m2)). 

b) Encoding at Block b: At block b, Tx^ transmits 
ruk^b using Xk{mkfi),k E {1,2}. Let m2,f>-i) 
denote the decoded (mi f,_i, 1712^-1) at block 6 — 1 at the 
relay. At block b the relay transmits X3(mi ^2,6-1). 
At block 6 = 1 the relay transmits X3(l,l), and at 
block b = B, Txi and Tx2 transmit xi(l) and X2(l), 
respectively. 

c) Decoding at the Relay at Block b: Decoding at 
the relay is very similar to the MARC case studied in 
[7, Sec. 4.D], the difference being that here feedback 
is available at the relay. In the present case, the relay 
uses its knowledge of Yi(6), Y2(6), Y3(5) and H(6) to 
decode (mi m2,f,) by using a joint-typicality decoder. 
The decoder looks for a unique pair, (mi,m2) £ Aii x 
M.2 that satisfies: 



{yii (mi ) , X2 (m2 ) , X3 (mi,;,_ 1 , m2,6- 1 ) , y 1 (^) , y2 (fe) , 
ymMb)) G ^2, ^3, 1^1,12,13,1). (6) 



Following the analysis in [7, Sec. 4.D], it is concluded 
that the achievable rate region for decoding at the relay 
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is given by: 

^Relay Decoding — 

< I{Xi;Y^,Y2,Ys\X2,X-i,H) 
R2<IiX2;Yi,Y2,Y3\Xi,Xs,H) 

Ri + R2<I{Xi,X2;Yi,Y2,Yi\X^,H) 



• (7a) 



d) Decoding at the Destinations at Block h: The 
receivers use a backward block decoding method as 
in ITi Appendix A]. Assume that each receiver has 
correctly decoded (mi b+i, m2,b+i). Recall that the code- 
books are generated independently, thus, in order to 
decode mk.b,k € {1,2} each receiver first decodes the 
interference, i.e., Rxi decodes m2^b and Rx2 decodes 

by treating the signal from the relay and its own 
desired signal as i.i.d. additive noise, independent of the 
interfering signal, which holds by construction of the 
codebooks and by the i.i.d. channel assumption. Note 
that for this decoding step the channel is treated as a PtP 
channel, the capacity of which is derived in ||39l Ch. 7.1]. 
Thus, due to Rx-CSI, Rxi can decode the interference if 



R2 < I{X2;Yi\Hi), 
and Rx2 can decode the interference if 

Ri < I{Xi;Y2\H2). 



(8a) 



(8b) 



After decoding the interference, each receiver uses its 
CSI to decode its desired message. We consider the 
decoding process at Rxi; the decoding process at Rx2 
follows the same steps. 

• Rxi generates the sets: 

£o,b = G Ml : (xi(mi_b+i),X2(m2,fe+i), 

X3(mi,m2,b),yi(fc+l),hi(6+l)) G 4")}. 
£i,b = G Ml : (xi(mi),X2(m2,fe), 

yi(6),hi(6)) gAW}. 

• Rxi then decodes mi i, by finding a unique mi G 

£o,b n £i^b- 

Note that since the codewords are independent of each 
other, Sofi is independent of Si^b- Thus, assuming m2,fe = 
771,2,6, and using standard joint-typicality arguments f39^. 
Theorem. 7.6.1], it follows that the probability of decod- 
ing error can be made arbitrarily small by taking n large 
enough as long as 

Ri < I{Xi-Yi\X2,Hi) + I{X^-Yi\Xi,X2,Hi) 
= I{Xi,X3;Yi\X2,Hi), (9a) 



and for decoding at Rx2 we obtain 

R2<I{X2,Xs;Y2\Xi,H2). 



(9b) 



Combining with ([8]) we conclude that subject to reliable 
decoding at the relay, the achievable rate region for 
decoding at the destinations is characterized by: 



n' 



Destination Decoding 



{Ri,R2)e^l : 

Ri<mm{l{Xi,Xs;Yi\X2,Hi), 
I{Xi-Y2\H2)} 
R2<mm{l{X2,Xs;Y2\Xi,H2), 

I{X2;Yi\Hi)} 
Hence, an achievable rate region is obtained by 



(10a) 



(10b) 



n 



Acliievable 



Relay Decoding 



Destination Decoding' 



(11) 



3 ) Capacity Region for the Very Strong Interference 
Regime: Now we obtain the conditions on the channel 
coefficients which guarantee that the interference is 
strong enough s.t. the receivers can decode the inter- 
ference without reducing the rate region. Combining (|7]) 
and (10 1 with ([8]), we obtain the VSI conditions for the 
ICRF: 

mm{l{Xi;Yi,Y2,Ys\X2,X3,m, 

IiXi,X3;Yi\X2,Hi)} < I{Xi-Y2\H2) (12a) 
min{/(X2;yi,y2,>3|^i,^3,t), 

I{X2, X3; Y2\Xi, H2)] < /(X2; Fil^i). (12b) 



Thus, when ( [T2| ) holds the achievable region is given 
by Q and ([7]). Note that since the codebooks are 
independent of each other and of the channel coefficients, 

I{Xi-Y2\H2) = h{Xi\H2)-h{Xi\Y2,H2) 

= h{Xi\X2,X3,H2)-h{Xi\Y2,H2) 
< hiXi\X2,X3,H) 

-h{Xi\Yi,Y2,Ys,X2,X3,H) 
= IiXi;Yi,Y2,Y3\X2,X3,H), (13a) 

we also obtain 

I{X2;Yi\Hi) < I{X2;Yi,Y2,Y3\Xi,X3,H). (13b) 
Hence, the conditions in (fT2l) reduce to 



IiXi,X3;Yi\X2,Hi) < I{Xi-Y2\H2) (14a) 
I{X2,X3-Y2\Xi,H2) < IiX2;Yi\Hi), (14b) 
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which give ([3]). Next, note that ([13) and ([14]) imply that 
the achievable region is characterized by ([9]l and ( [7a| . 



However, when ( 13 1 and ( 14 1 hold, then 



I{Xi,X2;Yi,Y2,Y^\X^,H) 
= I{X2;Yi,Y2,Y3\X3,H) 

+I{Xi;Y,,Y2,Ys\X2,Xs,H) 

> I{X2;Yi\Hi) + I{Xi-Y2\H2) 

> I{X2,X3;Y2\Xi,H2) + I{Xi,X3;Yi\X2,Hi). 

Therefore, we see that in the VSI regime, the sum-rate 
condition, ([Taj), is always satisfied. We conclude that 
when ([3) holds, ([4]) defines the achievable region. Finally, 
note that the rate region characterized by (|4]) coincides 
with the cut-set bound in section IV- A 1 (since ([4]) is only 
a subset of the constraints but it is achievable), hence ^ 
is the capacity region of the ICRF in the VSI regime. 

B. Ergodic Phase Fading 

The capacity region of ICRFs under ergodic phase 
fading in the VSI regime is characterized explicitly in 
the following corollary: 

Corollary 1. Consider the phase fading ICRF with Rx- 
CSI and noiseless feedback links from both receivers to 
the relay, s. t. y\~i , , h^i^i and h^2~i available at 
the relay at time i. If the channel coefficients satisfy 



ai2-P2 + ai2-P3 < 



1 + a^2^2 + a§2^3 



aliP2 



(15a) 



(15b) 



then the capacity region is characterized by all the 
nonnegative rate pairs s.t. 

Ri < log2 (1 + al^Pi + al^P^) (16a) 
R2 < log2 (1 + 42P2 + al^Ps) , (16b) 

and it is achieved with Xj. ~ CA/'(0, Pfc), k S {1, 2, 3}, 
mutually independent and with DF strategy at the relay. 

Proof: The proof follows from the expressions 
of Theorem [T] In order to obtain the conditions 



on the channel coefficients in (15), we evaluate 



/(Xi,X3;yi|X2,i/i) and /(X2, X3; Yal^i, i^2) using 
the right-hand side (r.h.s.) of equation ( |A. 10| ) in Ap- 
pendix [A| Recall that the channel inputs that maximize 
these expressions are mutually independent, zero mean, 
circularly symmetric complex Normal and with maxi- 
mum power. Thus, we obtain 



I{Xi,X:i-Yi\X2,Hi) 
I{X2,X3;Y2\Xi,H2) 



log2(l + a?iPi + aiiP3) 
log2i 



[I + al^P2 + ai^Ps) 



Note that for evaluating the r.h.s. of (|3]), {-f^3i,j^3,i}f=i 
and {Hii^iXi^i}f^^ are treated as additive Gaussian 
noise^ at Rxi and {i/32,i^3,j}r=i and {F22,i^2,i}f=i 
are treated as additive Gaussian noises at Rx2. Hence, 
we obtain 



IiX2;Yi\Hi) 
I{Xi-Y2\H2) 



logs 1 + 



^21^2 



log2 1 + 



1 + al^Pi + al^P^ 

al2Pi 
1 + al^P2 + al^P^ 



Thus ([3]) results in conditions ( [15] ) and ([4]) results in ( [T6] ). 



C. Ergodic Rayleigh Fading 

In this section the capacity region of ICRFs under er- 
godic Rayleigh fading in the VSI regime is characterized. 
Define tJk — {Ukk, U^k), k G {1, 2} and define Ei{x) as 
in lIMl Eqn. 5.1.1]: 

roc „—t 



Ei{x) 



t 



-dt. 



Corollary 2. Consider the Rayleigh fading ICRF with 
Rx-CSI and noiseless feedback links from both receivers 
to the relay, s.t. y\ i ,1/2^1 ,h\^i and h^2^i ^''^ available 
at the relay at time i. If the channel coefficients satisfy 



Tins, 



> (1 + a\^Pi + al,P3) 



(17a) 



'!i^i+°Si^3 



l+aj^Pi+aliPi 
a^J^2 

>{l + al^P2 + al^P3), (17b) 



then the capacity region is characterized by all the 
nonnegative rate pairs s.t. 

Ri < E^J log2(l + al,\UnfPi + al\Usi\^Ps)} (18a) 

R2 < Ej^J log2(l + a22|t/22|'P2 + ai2|C/32|'^'3)},(18b) 

and it is achieved with X^ ~ CM{0, Pk), k G {1, 2, 3}, 
mutually independent and with DF strategy at the relay. 

Proof: The proof follows the same approach as 
in Corollary [T] The detailed calculation of ([TTj) can 

^Recalling Xi , X2 and X3 are i.i.d. circularly symmetric complex 
Normal RVs with zero mean, their phases are distributed uniformly 
over [0, 2-n) i.i.d. and independent of each other and of the magni- 
tudes. Under the phase fading model, the channel coefficients have 
fixed amplitudes and their phases are i.i.d. and distributed uniformly 
over [0, 2ii). Thus, H^iXs,, HiiX\, H32X3 and H22X2 are mutually 
independent, zero mean, circularly symmetric complex Normal RVs 
as well. 
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be found in (W\. Recall that for Rayleigh fading, 
the channel coefficients are complex Normal RVs. 
Thus, for decoding the interference at the receivers, 
H31X3, HiiXi, H^2X-i and H22X2 cannot be treated as 
additive Gaussian noises. Hence, the mutual information 
expressions on the r.h.s. of Q need to be bounded using 
the El function. ■ 

D. Comments 

Comment 5. We now compare the capacity region of 
the ICRF in VSI to the ICR without feedback in VSI. 
First, consider the phase fading model, and define the 
set of coefficients Ppi? as follows: 



T^PF - I (031, 013,032, 023) G ■ 



a?iPi+aiiP3 <a?3A 



iii^i 

022^2 + ai2^3 < 023^2 

,2 D I „2 D N/i I „2 D I „2 



(19a) 
(19b) 



(1+ aiiPi+ aiiP3){l+ 42P2+42P-i) 

< l+al^Pi+43P2]. (19c) 

In ifTTl Theorem 1] it is shown that when the channel 
coefficients satisfy ( [TS] ) and (031,(113,032,023) S Vpp, 
then capacity of the ICR is given by ([16]). Note that 
(031,013,032,023) G T^pp implies that the links from 
the transmitters to the relay are good in the sense that 
if a rate pair can be reliably decoded at the destinations, 
then, it can also be reliably decoded at the relay. Observe 



that feedback does not affect the rate constraints (16 1, 



thus, when capacity is achieved without any feedback, 
then additional feedback links from each receiver to the 
relay do not enlarge the capacity region. Hence, the 
main benefit of feedback to the relay is that it allows 
to achieve capacity in VSI /or any quality of links from 
the transmitters to the relay. Therefore, the set of channel 
coefficients for which capacity is achieved is defined 
only by (fTS]) without the additional restrictions of Vpp. 



We also note that for the ICRF, when (15 1 holds. 



the cut-set bound is given by ( [76] ). Consider next the 
ICR in which ( [T5| ) holds yet (031, 013, 032, 023) ^ Vpp. 
Taking 013,023 — )• 0, we eventually obtain that the cut- 
set bound (see |18, Eqn. (C.l)]) is a subset of ([16]). For 
such scenarios, feedback enlarges the capacity region 
compared to the no-feedback case. Similar conclusions 
hold also for Rayleigh fading. 

Comment 6. Fig. [2] shows the position of the relay in a 
2D-plane in which the VSI conditions, ([3]), are satisfied 
for the phase fading scenario with Pi = P2 = 10, P3 = 
3. For phase fading ([3]) are evaluated to be (15 1 . Each 



channel coefficient Ojj is related to the distance dij from 
node i to node j via Oj, = 4-, and hence the path-loss 



exponent is 4, corresponding to the two-ray propagation 
model. The locations of the transmitters and the receivers 
are fixed, thus the corresponding channel coefficients are 
fixed to be on = 022 = 0.18 and 012 = 021 = 0.25. 
Note that indeed the cross-links are stronger than the 
direct links. 

From the figure we observe that with feedback, the 



VSI conditions ( [15] ) hold (hence, the capacity region 
is known) in both the black and the gray areas, while 
without feedback, the conditions (TT. Eqns. (8) and (9)] 
hold only in the black area, thus capacity is achieved 
with DF only in that area. This clearly shows the benefits 
of feedback. Note that without feedback, the relay has 
to be close to the transmitters and far enough from 
the destinations, to satisfy the conditions [17, Eqns. (8) 
and (9)]. This is because the signal received from the 
relay should not increase too much the noise level when 
decoding the interference first, and it also should not 
increase too much the rate of the desired information. 
This is needed in order to make sure that the unintended 
receiver can decode its interference based only on the 
cross-link signal component, while the desired message 
and the relay signal are treated as noises. 




Fig. 2: The geographical position in the 2D-plane in which the 
VSI conditions hold for the ICR subject to phase fading. The 
black region shows the location of the relay for ICRs without 
feedback in which DF at the relay achieves capacity at VSI. 
The union of the black and gray regions shows the location of 
the relay for ICRFs in which DF at the relay achieves capacity 
at VSI. The scenario parameters are detailed in Comment [6] 



Comment 7. Note from (]4]) that in the VSI regime, the 
ICRF behaves like two parallel relay channels. 

Comment 8. Although in practice there is only one 
relay node, it is simultaneously optimal for both "par- 
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allel relay channels" s.t. capacity is achieved in both 
simultaneously. From a practical aspect, this observation 
gives a strong motivation to employ a combination of 
relaying and feedback in wireless networks since a 
relatively small number of relay stations can optimally 
assist several nodes simultaneously. 

Comment 9. Note that since the capacity achieving 
channel inputs are mutually independent, adding relay 
nodes to the existing wireless networks does not re- 
quire any modifications in the transmitters codebooks. 
Hence, these techniques (relaying with feedback) can be 
incorporated into current designs in a relatively simple 
manner. 

Comment 10. We now discuss the implication of having 
feedback of only channel outputs without CSI. Recall 
that in Comment [5] it is noted that, since feedback 
includes Rx-CSI as well as channel outputs, then, when 
feedback from both destinations to the relay is available, 
we can employ the DF scheme to obtain a charac- 
terization of the capacity region for any quality of 
links from the transmitters to the relay. When feedback 
does not include CSI from the receivers, then decoding 
the sources' messages at the relay leads to additional 
restrictions on the channel coefficients, which are needed 
in order to arrive to a capacity characterization using DF. 
These restrictions decrease the set of channel coefficients 
for which the capacity region of the ICRF is achieved 
by the DF scheme. It should be emphasized that when 
the channel coefficients satisfy the additional restrictions, 
then the SI/VSI conditions are the same as those obtained 
with feedback that includes both Rx-CSI as well as 
channel output, and so are the rate constraints. 

Comment 11. Note that the capacity result in Theorem 
[T] holds also when there is no independent receiver at 
the relay, i.e., when Is = 0, in the VSI regime. This 
observation holds only in scenarios where there are two 
noiseless feedback Unks, one from each receiver to the 
relay and not with partial feedback at the relay which will 
be studied in section |VII[ This is because the feedback 
turns each component relay channel into a degraded 
channel in the sense of 0. In the next sections PvT 



|VII[ where we consider feedback to the transmitters and 
partial feedback, degradedness does not occur. 

V. ICRFs IN THE Strong Interference Regime 

In this section, we characterize the capacity region 
of ICRFs in the SI regime. We consider two noiseless 
feedback links, one from each receiver to the relay. This 
capacity region is characterized in the following theorem: 



Theorem 2. Consider the fading ICRF with Rx-CSI. 
Assume that the channel coefficients are independent 
in time and independent of each other s. t. their phases 
are i.i.d. and distributed uniformly over [0, 27r). Let the 
additive noises be i.i.d. circularly symmetric complex 
Normal processes, CA/'(0, 1), and let the sources have 
power constraints E||Xfcp} < P^, k G {1,2,3}. 
Assume noiseless feedback links from both receivers to 
the relay. If 

I{Xi,Xs;Yi\X2,Hi) < I{Xi;Y2\X2,H2) (20a) 
I{X2,X3;Y2\Xi,H2) < I{X2;Yi\Xi,Hi), (20b) 

where the mutual information expressions are evaluated 
with Xk ~ CM{0,Pk),k £ {1,2,3}, mutually inde- 
pendent, then the capacity region is given by all the 
nonnegative rate pairs s.t. 

Ri<I{Xi,X^-Yi\X2,Hi) (21a) 
R2<I{X2,X^-Y2\Xi,H2) (21b) 
Ri+R2< min{/(Xi,X2,X3;yi|i7i), 

/(Xi,X2,X3;y2|^2)},(21c) 

and it is achieved with X^ ~ CA/'(0, Pk), k £ {1, 2, 3}, 
mutually independent and with DF strategy at the relay. 

A. Proof of Theorem |2] 

The proof consists of the following steps: 

• From the ICRF we obtain the enhanced MARC 
(EMARC) as a MARC whose message destination 
is one of the destinations of the ICRF, but the relay 
receives feedback from both receivers. Therefore, 
EMARCi is defined by equations ([T]) and its re- 
ceiver is Rxi and EMARC2 is defined by equations 
([T]) and its receiver is Rx2j^ 

• We derive the capacity region of EMARCi and 
EMARC2. 

• We show that the same coding strategy at the 
sources and at the relay achieves capacity for both 
EMARCs simultaneously. 

- We therefore obtain an achievable rate region 
for the ICRF as the intersection of capacity 
regions of EMARCi and EMARC2. 

• We show that in the SI regime the intersection of 
the capacity regions of EMARCi and EMARC 2 
contains the capacity region of the ICRF . 

• We characterize the SI conditions for the ICRF. 

' Note that this definition is different from the usual definition 
of MARC, since in the present scenario feedbaclc comes from both 
receivers but only one receiver is decoding. Thus, for each EMARC 
(^il.^ , 1/2 j.^ J ^]ri 1 ^2^1 ) denotes the available feedback at the relay 
at time i prior to the transmission of the i'th symbol. 
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• We conclude the capacity region of ICRF in the SI 
regime is equal to the intersection of the capacity 
regions of EMARCi and EMARC2. 
The first three steps are detailed in section V-A1| and the 



last three steps are detailed in section V-A2 
1) An 



Define 



Achievable Rate Region: 
a = ^ (aiij 021,031, 012,022, 032, 013,023)- Let 
Vi i ' ^2 1^ ' ^11^ ' ^21^ denote the available feedback 
at the relay at time i in EM ARC 1 and EM ARC 2 
and let CEMARCi(a) and CEMARC2(a) denote their 
capacity region, respectively. Let tj^{Ri,R2) denote the 
coding strategy (codebooks, encoders and decoders) for 
EMARCfc that achieves rate pair R2). The capacity 
regions of the EMARCs are shown in Appendix |B] to 
be: 

Cemarci (a) 

= |(i?i,i?2) : 

Ri < min{l{Xi-Yi,Y2,Y^\X2,X^,H), 

I{Xi,X^-Yi\X2,Hi)] {11^) 

R2 < min{/(X2;yi,y2,>3|^i,^3,t), 

/(X2,X3;yi|Xi,#i)} (22b) 

i2i + i?2 < mill { /(Xi , X2 ; , y2 , ^3 , 1) , 
/(Xi,X2,X3;yi|#i)}| (22 



c) 



Cemarc2 (a) 

(i?i,i?2) e?^^ : 

i2i < min{/(Xi;yi,y2,l3|X2,X3,t), 

/(Xi,X3;y2|X2,^2)} (23a) 
R2 < min{/(X2;yi,y2,>3|^i,^3,t), 

/(X2,X3;y2|^i,^2)} (23b) 
Rx^R2< min { /(Xi , X2 ; , Fa , I3 1 ^3 , t ) , 

/(Xi,X2,X3;y2|^2)}|, (23c) 



where X^ ~ CJ\f{0,Pk),k G {1,2,3} are mutually 
independent and DF is used at the relay. 
Next, we have the following proposition: 

Proposition 1. The same coding strategy at the sources 
and at the relay achieves capacity for both EMARCs 
simultaneously, i.e., 

Cemarci (^) 1^ Cemarc2 (^) ^ CicRF (a) . (24) 

Proof: In Appendix |B] it is shown that the ca- 
pacity region of each EMARC is achieved with DF 



strategy at the relay and codebooks generated accord- 
ing to independent circularly symmetric complex Nor- 
mal distribution at the sources and at the relay (the 
same distributions are used in both EMARCs). In both 
EMARCs, for all rate pairs {Ri,R2), the relay code- 
book has 2"(^i+^2) codewords generated i.i.d. according 
to CM{0,Ps), independent of the codewords at the 
sources. For all rate pairs (i?i,i?2) the same scheme 
is used at the relay in both EMARCs: at block b the 
relay decodes the messages {rrii^b, m2,b) via a joint- 
typicality decoder using (yi(6),y2(6),y3(6),h(6)), and 
transmits X3(mi m2,6). Thus, all rate pairs {Ri,R2) 
s.t. (i?i,i?2) G CEMARCi(a) nCEMARCaCa) are achieved 
at both EMARCs simultaneously with ti{Ri,R2) = 
t2{Ri,R2) = tDF{Ri,R2), where tDF{Ri,R2) is the 
coding strategy detailed in Appendix |B} for achieving 
the rate pair (i?i,i?2)- ■ 
From Proposition [T] it follows that an achievable rate 
region for the ICRF, 7^/ci?F(a, ^df) (here tup should 
be understood as the DF strategy appropriate for each 
rate pair in the achievable region, see Appendix [B), can 
be obtained by: 

T^icrf{^, ^df) 

= CEMARCi(a) n CEMARC2(a) ^ CiCRF(a), (25) 

and it is achieved with X^ ~ CM{0,Pk),k £ {1,2,3}, 
independent of each other and with DF strategy at the 
relay. 

2) Converse: By definition of the SI regime, in this 
regime both receivers can decode both messages without 
reducing the capacity region, i.e., any achievable rate pair 
R2) G CicRF(a) is also achievable in EMARC 1 and 
EMARC2, hence CicRF(a) C CEMARCi(a)nCEMARC2(a). 
Combined with equation ( [25] ) we conclude that in the SI 
regime CicRF(a) = CEMARCi(a) nCEMARCaCa)- Hence, 
the only problem left open is to determine the SI 
conditions for the ICRF. Note that from proposition [T] 
we obtain that CemarCi (a) and Cemarc2 (a) are achieved 
with t£)F, thus for the rest of the proof we only con- 
sider mutually independent, circularly symmetric com- 
plex Normal channel inputs with zero mean. The rest of 
the proof consists of the following steps: 

• We assume an achievable rate pair (i2i,i?2) in the 
ICRF. 

• We characterize the maximal rate at which each 
receiver can decode its desired message. We con- 
clude that this rate is achieved with independent 
channel inputs generated i.i.d. according to the 
circularly symmetric complex Normal distribution 



(see Theorem B.l in Appendix [B]). 

We characterize the worst case conditions for each 

receiver to decode the interfering message. 
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• We derive the conditions for which decoding both 
messages at each receiver does not reduce the 
capacity region. 

For the first two steps note that the maximal rates 
for decoding at the destinations are given by the cut-set 
bounds in Q, i.e., 

maxi?i =sup |min{/(Xi;yi,y2,>3|^2,^3,^), 

f{Xi,X2,X3) 

I{Xi,X3;Yi\X2,Hi)}] (26a) 
maxi?2 =sup [mm{l{X2;Yi,Y2,Y3\Xi,Xs,H), 

f{Xi,X2,X3) 

I{X2,Xs;Y2\Xi,H2)}}, (26b) 



and they are achieved with mutually independent, cir- 
cularly symmetric complex Normal channel inputs with 
zero mean and with DF at the relay (see Appendix 
[B] for a detailed proof). The worst case scenario for 
decoding at the destinations, however, is when the sig- 
nal from the relay degrades the performance of the 
receivers. Given two vectors, a and b, define the notation 
a • b = (ai6i, 0262, a„6„). Assume the rate pair 
{Ri,R2) G CicRF(a). If Rxi can decode mi from the 
signal 

yi = hii • xi + h2i • X2 + hai • X3 + zi, 
then it can create the signal 

y[ = h2i • X2 + hsi • X3 + zi, 



from which it can decode m2 by treating h^i ■ X3 as 
additive nois^^if 



R2 < IiX2;Yl\Hi) ^ R'^. 
Similarly, Rx2 can decode mi if 

Ri < I{Xr,Yi\H2) = R[. 

Next, we should guarantee that decoding both messages 
at each receiver does not reduce the capacity region 
of the ICRF. This is achieved if maxi?i < R[ and 



Note that for this step we use the fact that the codebooks are 
generated independently, hence the relay signal can be treated as 
additive noise. 



maxi?2 ^ ^2' i-^-' 

sup {mm{l{Xi;Yi,Y2,Y3\X2,Xs,H), 

f{xi,X2,X3) 



IiXuX3;Yi\X2,Hi)}] 



<I{Xr,Yi\H2) 

(a) 



I{Xi;Y2\X2,H2), 
sup I min {l{X2;Yi,Y2,Y3\Xi,Xs,H), 

f{xi,X2,X3) 



I{X2,X3;Y2\Xi,H2)}] 



< I{X2;Y;\Hi) 

= IiX2;Yi\Xi,Hi), 

where (a) follows from the fact that the capacity region 
of the ICRF in the SI regime, as well as the supremum on 
the left-hand side (l.h.s.) of the inequality, are achieved 
with Xk ~ CAf{0, Pk),k G {1,2,3}, independent of 
each other and of the channel coefficients; thus all mutual 
information expressions are evaluated with the same 
distribution. Note that from arguments similar to those 
used in section |IV-A3t we also obtain that 



I{Xi;Y2\X2,H2) < IiXi;Yi,Y2,Y3\X2,X3,H) 
I{X2;Yi\XuHi) < IiX2;Yi,Y2,Y3\XuX3,H). 

Thus, to guarantee that maxi?i < R[ and maxi?2 < 
i?2, it is enough to require 

I{Xi,Xs;Yi\X2,Hi) < I{Xi;Y2\X2,H2) (27a) 
IiX2,X3;Y2\Xi,H2) < IiX2;Yi\Xi,Hi), (27b) 



which give ( |20| ). Hence, when ([27]) holds, CicRF(a) = 

CeMARCi i^l) n CemARC2(^2)- 

Comment 12. Note that the argument presented here 
uses only local Rx-CSI, as opposed to the argument of 
Sato II. 

3) Simplification of the Capacity Region: Consider 
the constraints on Ri in ( 22a ) and ( 23a| ). Note that if 



( p7| ) holds, since the channel inputs are independent of 
each other and of the channel coefficients, we get 

IiXi,X3;Yi\X2,Hi) < I{Xr,Y2\X2,H2) 

< IiXi,X3;Y2\X2,H2), 
IiXi,X3;Yi\X2,Hi) < I{Xi;Y2\X2,H2) 

< IiXr,Yi,Y2,Y3\X2,X3,H). 



Thus, the constraints on Ri in ([22a 1 and ( 23a i can be 
reduced to 



Ri<I{Xi,X3;Yi\X2,Hi) 



(28a) 
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Following the same steps, the constraints on R2 in (|22b[) 



and ( |23b| ) can be reduced to 

R2<I{X2,Xs;Y2\Xi,H2). 



(28b) 



Finally, note that since the channel inputs are indepen- 
dent of each other and of the channel coefficients, then 

I{Xi;Y2\Hi) < I{Xr,Y2\X2,H) 

< I{Xr,Yi,Y2,Y3\X2,X3,H) 
I{X2;Yi\Hi) < I{X2;Yi,Y2,Y3\X3,H). 

Hence, when pT) is satisfied, 

IiXi,X2;Yi,Y2,Y3\X3,H) 

= IiX2;Yi,Y2,Y3\X3,H) 

+I{Xi;Yi,Y2,Y3\X2,X3,H) 
> I{X2;Yi\Hi) + I{Xi,X3;Yi\X2,Hi) 
= I{Xi,X2,X3;Yi\Hi), 

and 

I{Xi,X2;Yi,Y2,Ys\Xs,H) > /(Xi, X2, X3; ^21^2), 

implying that in the SI regime, the sum-rate conditions 
for decoding at the relay is always satisfied. This shows 



that when ( 20 1 holds, the capacity region is characterized 



in (21 1. 



B. Ergodic Phase Fading 

When the channel is subject to ergodic phase fading, 
we obtain the following explicit result: 

Corollary 3. Consider the phase fading ICRF with Rx- 
CSI and noiseless feedback links from both receivers to 
the relay, s. t. y^^^ , , h\~^ and h^2~i '^^^ available at 
the relay at time i. If the channel coefficients satisfy 

(29a) 
(29b) 



af,Pi + a^iP3<^^ . 



32-f"^3 
21^2 



then the capacity region is characterized by all the 
nonnegative rate pairs s.t. 



Ri < log2 (1 + afiPi + aiiPa) 
R2 < log2 (1 + a^2^'2 + ai2^'3) 



(30a) 
(30b) 



R1 + R2 < mill I log2(l + a?iPi + aiiP2 + ally's), 

log2(l + al2Pi + al^P2 + aiaPs)}, (30c) 

and it is achieved with X^ ~ CJ\f{0, Pk), k E {1, 2, 3}, 
mutually independent and with DF strategy at the relay. 



Proof: The result follows from the expressions 
of Theorem [2l In order to obtain the conditions 
on the channel coefficients in ( |29l ) we first evaluate 
I{Xi,X^-Yi\X2^Hi) and /(X2, X3; ^21^1, ^2) as in 
Corollary [T] by using the r.h.s. of ( |A.10 l. Also note that 



{i/31 i^3,i}F=i can be considered as additive Gaussian 



noisqj at Rxi and {-f^32,i-'^3,i}r=i ^^"^ considered 
as additive Gaussian noise at Rx2. Therefore from the 
independence of the channel inputs we obtain 



I{X2;Yi\Xi,Hi) = log2 1 + 



I{Xr,Y2\X2,H2) = log2 1 + 



aliP2 
1 + ai.Ps 

1 + 022P3 



Thus, by evaluating (|20]) we obtain the conditions in 
( |29l ). Finally, we evaluate I{Xi, X2, X^-Yi\Hi) and 
/(Xi,X2,X3;y2|^2) by using the r.h.s. of ( |53] ): 



I{Xi,X2,X^-Yi\Hi) 

= log2(l + afiPi + al^P2 + al^P^) 
I{Xi,X2,X3;Y2\H2) 

= log2(l + a?2A + ^22^2 + ^32^3) 



C. Ergodic Rayleigh Fading 

Define Uk = iUkk,U3k),k G {1,2} and U ^ 
{Un, U12, U21, U22, U31, 1/32)- When the channel is sub- 
ject to ergodic Rayleigh fading, we obtain the following 
explicit result: 

Corollary 4. Consider the Rayleigh fading ICRF with 
Rx-CSI and noiseless feedback links from both receivers 
to the relay, s.t. y\~i ,y2~i ^"'^ ^2~i^ '^'^^ available 

at the relay at time i. If the channel coefficients satisfy 



'+"32 / 1 , 2 D 



e El 



> {l + aliPi + aliP^i) (31a) 



> (l + ai2P2 + ai2P3), (31b) 



then the capacity region is characterized by all the 
nonnegative rate pairs s.t. 

Ri < E^^{ log2(l + ali\Uii\^Pi + ali\Usi\^P3)}(32a) 

R2 < Ej^J log2(l + 42\U22\^P2 + al2\U32\^P3)}i32h) 

Ri + R2< mill |e^{ log2(l + a?fc|f/ife|'Pi 

fcG{l,2} — 

+aifc \U2k\^P2 + aifc I C/3fc I 'P3 ) } } , (32c) 
^Here we follow the same arguments as in Corollary |I] 
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(a) The range of ai2 and 021 which satisfy the conditions 
for the VSI regime (gray area only) and for the SI regime 
(both black and gray areas) when DF achieves capacity in 
the phase fading scenario. 




04 05 06 
[bits/symbol] 

(b) The capacity region of the ICRF for the phase fading 
scenario in the VSI regime (both black and gray areas, 
112 ~ £121 = 0.7) and the SI regime (black area only, 
ai2 = 0.53, 021 = 0.36) 

Fig. 3: SI and VSI for Pi = P2 = = 10, an 
0.42, a22 = 0.25, 031 = 0.26 and 032 = 0.1. 



k = 1,2. Let a = 

(011,012,013,021,022,023,031,032) G ^% 

and let a G Pi n P2 be a short form 
notation to denote that ai and a2 satisfy 

{ai U a2 = a} n {ai e Pi} n {a2 G V2}. 

lITTl Theorem 2] states that when the channel coef- 
ficients satisfy ([29]) and also a G "Di n P2, then the 
capacity region is given by ( |30l ). Similar to VSI (see 
Comment |5]l, observe that the rate constraints are the 
same for both the feedback and the no-feedback cases, 
thus when capacity is achieved without feedback, then 
feedback does not enlarge the capacity region. Using 
similar arguments as in the discussion in Comment |5] 
it is possible to show that when (29 1 hold, then there 
are situations in which feedback enlarges the capacity 
region. The same conclusion applies to Rayleigh fading 
as well. 

Comment 14. Since the optimal codewords are gen- 
erated independent of each other and of the channel 
coefficients, we obtain 

I{Xi;Y2\H2) < I{Xr,Y2\X2,H2) 
I{X2;Yi\Hi) < IiX2;Yi\Xi,Hi), 

thus, its easy to see that the SI conditions in ( |20l ) are 
weaker than the VSI conditions in (|3]l, as depicted in 



Fig. 3a The capacity region are compared in Fig. 3b 



Comment 15. Although in the SI regime the resulting 
model can be thought of as a "compound EMARC", 
it is important to note that both EMARCs share the 
same relay and thus they are not separate, contrary to 
ICs without relay. Note that the strategy at the relay is 
optimal for both EMARCs s.t. capacity is achieved for 
both simultaneously. 



and it is achieved with X^ ~ CM{0, Pk), k G {1, 2, 3}, 
mutually independent and with DF strategy at the relay. 

Proof: The result follows from the expressions of 
Theorem [2] and follows the same approach as in the proof 
of Corollary |3] Here (31_l follows from [18, Proposition 
1]. ■ 

D. Comments 

Comment 13. In order to compare the feedback ca- 
pacity region of Corollary [3] to that obtained without 
feedback, let Vk be the set of channel coefficients 

afc = (oifc,02A:,03A;,oi3,023) G that satisfy 

<^lkPi + 4kP^ < 4iPi (33a) 
4kP2 + 4kP^ < 43P2 (33b) 
alkPi + 4kP2 + alkPi < 4iPi + 43P2, (33c) 



VI. ICRs WITH Feedback to the Relay and 
Transmitters 

In this section we study the scenarios in which feed- 
back is available both at the relay and at the transmitters. 
We consider two configurations: (1) feedback from each 
receiver to the relay and to its opposite transmitter, (2) 
feedback from each receiver to the relay and to its 
corresponding transmitter. 

A. Feedback to the Opposite Transmitters 

First, we study how the capacity region is affected if 
there are two noiseless feedback links from each receiver, 
both to the relay and to its opposite transmitter, s.t. 



, h\ I are available at Tx2, 1/2 i, h\ ^ axe. available 



at Txi, and y\i ,y2i ,h\i ^h\i are available at the 
relay at time i, prior to the transmission at each node. 
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for this scenario, the definitions of the encoders at the 
transmitters in Definition [T] are modified as follows: 



(34a) 
(34b) 



the rest of the definitions remain unchanged and they 
are the same as in section |ll] This model can represent 
scenarios where each transmitter is close to its opposite 
receiver, e.g., when VSI occurs in the ICRF. This con- 
figuration is depicted in Fig. |4] 

Proposition 2. Consider the ICRF in which there is a 
noiseless feedback link from each receiver to the relay. 
Then, additional feedback links from each receiver to 
its opposite transmitter (see Fig. do not provide any 
further enlargement to the capacity region in the VSI 
regime. 

Proof: Let mi G 7Wi,m2 € A42 denote the 
messages that Txi and Tx2 send to Rxi and Rx2, 
respectively. Let the encoders at Txi and Tx2 map 
their messages and the information received from their 
feedback links into the channel input symbols xi^i and 
X2,i, respectively. Thus, the encoders at the transmitters 
are given in (|34]l. The encoder at the relay remains 
unchanged, i.e., it is the causal function given in (|2]). 
Consider the cut-set bound expressions in ([5]). Observe 
that in the cut-set bounds on Ri , Rxi and Tx2 belong to 
5*^ while Txi and Rx2 belong to S. Hence, by inspection 
of the proof of the cut-set bound |[39l Theorem 15.10.1], 
it is evident that the encoders at Txi and Tx2 used for the 



cut-set expressions are exactly those in p4} and therefore 
the cut-set expressions for rates Ri and i?2 in Q remain 
unchanged when feedback is also sent from each receiver 
to its opposite transmitter. 

Finally, note that Theorem [T] proves that in the VSI 
regime, if feedback from both receivers is available at the 



relay then the cut-set bounds ( [5b| ) and ( [5d| ) are achievable 
and there is no constraint on the sum-rate. Hence, we 
conclude that when feedback from both receivers is 
available at the relay then additional feedback links from 
each receiver to its opposite transmitter do not enlarge 
the capacity region of the ICRF in the VSI regime. ■ 
I) Comments: 

Comment 16. In [20] it was shown that feedback can 
increase the capacity region of the discrete memoryless 
MAC by allowing the sources to coordinate their trans- 
missions. In the ICRF with additional feedback links 
from each receiver to its opposite transmitter, since the 
cut-set bound expressions are maximized with mutually 
independent channel inputs then such coordination is not 
beneficial and in fact it is not possible. 



Comment 17. We conclude that if, due network limita- 
tions, each receiver may send feedback either to the relay 
or to its opposite transmitter (when in the VSI regime 
Q), then its preferable to send feedback to the relay, 
since the relay can exploit the additional information to 
achieve the capacity in the VSI regime. 



B. Feedback to the Corresponding Transmitters 

In this section, we study how the capacity region is 
affected if there are two noiseless feedback links from 
each receiver, both to the relay and to its corresponding 
transmitter, s.t. yl~i , h\^i are available at Txi, y2i, 
are available at Tx2, and yii,y2i, ^11^) ^2~/ avail- 
able at the relay, at time i, prior to the transmission 
at each node. For this scenario the encoders at the 
transmitters in Definition [T] are changed to 



xi,i = ei^i{mi,y{-^ ,h\-^ ) 
X2,i = e2,i{m2,y'2'i,h2~i), 



(35a) 
(35b) 



the rest of the definitions are the same as in section [III 
This configuration is depicted in Fig. |5] 




Fig. 5: The interference channel with a relay and feed- 
back from both receivers to the relay and to their 
corresponding transmitters. The 'D' block represents a 
single- symbol delay. 

Let Cmac-fb and TZob be defined as 

Cmac-fb 
^ '{Ri,R2)€^l: 

Ri < I{Xi;Yi,Y2,Y3\X2,Xs,H) (36a) 
R2 < I{X2;Yi,Y2,Y3\Xi,X3,H) (36b) 

Ri + R2<I{Xi,X2;Yi,Y2,Y3\X3,H) l,(36c) 
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Fig. 4: The interference channel with a relay and feedback from both receivers to the relay and to their opposite 
transmitters. The 'D' block represents a single-symbol delay. 



iRi,R2)e^l : 

Ri < I{Xi,Xs-Yi,Y2\X2,H) (37a) 

R2 < I{X2,X3;Yi,Y2\Xi,H) (37b) 

Ri + R2< IiXi,X2,X3;Yi,Y2\H) ], (37c) 



where all mutual information expressions in p6\ and 
([37]) are evaluated with Xk ~ CM{0,Pk), k = 1,2,3, 
mutually independent. Next, define the region II^crf 
as follows: 

^VSI 



{Ri,R2)£^l : 

R2<I{X2,Xr,Y2\Xi,H2) 

Ri<I{Xi,X2,X3;Yi\Hi) 
I{X2;Yi\Hi) 



-Ri 



I{X2,X^;Y2\Xi,H2) 

where all mutual information expression are evaluated 
with Xk ~ CJ\f{0, Pk), k = 1,2,3, mutually indepen- 
dent. We now state the inner and outer bound in the 
following proposition: 

Proposition 3. The capacity region of the ICRF with 
noiseless feedback links from each receiver to the relay 



and to its corresponding transmitter, denoted Cicrf, 
is outer bounded by Cjcrf ^ Cmac-fb H IZqb- 
Furthermore, if the VSI conditions (3) hold and also 

I{Xi,X2,Xr,Yi\Hi) < I{Xr,Y2\X2,Xs,H2), (38) 

holds for mutually independent Gaussian inputs, Xk ~ 
CAA(0, Pfc), k = 1,2,3. Then, the corresponding capac- 
ity region of the ICRF in the VSI regime, denoted C^Q^p, 

Proof: See Appendix |C] ■ 
As a direct consequence of Proposition [3] we have the 
following corollary: 

Corollary 5. Consider the ICRF with two noiseless 
feedback links from the receivers to the relay. Then, 
additional feedback links from each receiver to its cor- 
responding transmitter ( see Fig. |5]), enlarge the capacity 
region in the SI and VSI regimes. 

I) Comments: 

Comment 18. Note that feedback to the corresponding 
transmitters also increases the capacity region of the 
ICRF in the SI regime. The proof is identical to the 
one used in Proposition [3] subject to ([38]l and condi- 
tions (20 1. In particular, the outer bound is identical 
to that in the proof of Proposition [3] and the achiev- 
able rate region is obtained by time sharing between 
{l{Xi, X2, X3;Yi\Hi),0) and the rate points of the SI 
region ( |2T] ). 
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Comment 19. Note that in the coding scheme described 
in Proposition [3j Tx2 behaves like a second relay node 
for Txi, i.e., the ICRF is transformed into a multiple 
relay channel. It should also be noted that when Tx2 
cooperates with Txi and with the relay in sending mi, 
this decreases the maximal rate of information that could 
be sent from Tx2 to Rx2. However, as this cooperation 
increases the maximal achievable rate from Txi to Rxi, 
compared to the case where feedback is available only 
at the relay, the capacity region is increased. 

Comment 20. Recall that in the classic relay channel 
Rx-Tx feedback does not enlarge the capacity region 
once feedback from the receiver is available at the relay 
node. In ICRF, in contrary to the classic relay channel, 
Rx-Tx feedback can enlarge the capacity region beyond 
what is achieved with Rx-relay feedback. Thus, not all 
of the insights from the study of the classic relay channel 
hold for the ICRF. 

Comment 21. The boundaries of 'R-YcRF ^^'^ 
Cmac-fb n TZoB, together with the capacity 
region of the ICRF in the VSI regime are depicted 
in Figure [6] Observe that adding feedback to 
corresponding transmitters increases the capacity 
region of the ICRF in the SI and the VSI regimes. 
Also observe from the figure that the rate point 
{l{Xi,X2,Xr,Yi\Hi),I{Xi,X2,X3;Y2\H2)) is 
outside the outer bound. This shows that the outer 
bound is not trivial. Since IZob ^ Cmac-fb and 
Cmac-fb ^ T^OB, then both regions are needed in the 
outer bound. 



VSI region with Rx-re[ay FB 

VSI region with Rx-corresponding Tx FB 

MAC OB 

Cut -Set OB 



Next, we note that when ( |38] ) holds for mutually in- 
dependent Gaussian inputs, then the achievable rate pair 
{Ri,b,R2,b) = {l{Xi,X2,X3;Yi\Hi),0) is clearly 
on the boundary of the capacity region of the ICRF 
with additional feedback links from each receiver to 
its corresponding transmitter. Therefore, for this rate 
pair our achievability scheme is tight. We note that 
in all expressions in the outer bound, both signals 
(Yi,Y2) appear together. Therefore, we do not expect 
the outer bound to be tight. However, the outer bound 
is not trivial as it excludes the rate point (i?i,i?2) = 
{I{Xi,X2,X:,-Yi\H{),I{Xi,X2,X^-Y2\H2)). 

Comment 22. We note that it is not possible to apply 
directly the cut-set bound [39, Thm. 15.10.1] to the 
present case. To demonstrate this, consider the rate from 
Txi to Rxi. To obtain the corresponding bound using 
the cut-set theorem one should assign Txi and Rx2 to S 
and Tx2 and Rxi to S'^. Now, to generate Xg" we need 
both W2 and ^2^1 (see, e.g. EH Eq. (15.330)]). But as 
Rx2 G S, then this is not a valid assignment. In order to 




.5 2 

R.. [bits/symbol] 



Fig. 6: The capacity region of the ICRF in the VSI 
regime with Rx-relay feedback and without Rx-Tx feed- 
back (the gray area) and the achievable region of Propo- 
sition [3] (gray and black area), when the channel is 
subject to phase fading and Pi = P2 = Pz = 10, 
ail = 0.2, ai2 = 0.44, 022 = 0.2, 021 = 0.27 
, ai3 = 0.01, a23 = 0.6, 031 = 0.1, and 032 = 
0.1. Point C corresponds to the rate pair (i?i,i?2) = 
(I(Xi,X2,X3;yi|^i),I(Xi,X2,X3;y2|^2)). Observe 
that this rate pair is outside the outer bound. 



handle feedback to corresponding transmitters, we treat 
(Yi, 12) as a single MIMO receiver when deriving IZob- 

Comment 23. In |[30l and Il311 . Xie and Kumar derived 
achievable rates for relay channels with k different relay 
nodes where B — k messages are sent in B transmission 
blocks. Xie and Kumar proposed a scheme where the 
/'th relay node transmits only after the transmission of 
the source and the first / — 1 relays are finished. Note that 
in general the coding scheme proposed in [30] and |[3T| 
achieves higher rates for the relay channels, however, in 
the SI and VSI regimes as defined in Theorems [T] and |2] 
there is no such improvement. 

Comment 24. Recall that in lISTl it was shown that 
feedback can provide an unbounded gain as the SNR 
and INR increase to infinity. In [26] it was shown 
that an unbounded capacity gain can be obtained 
also for the weak interference regime. We note that 
these results deal with the degrees of freedom of 
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the channel, thus the conclusion holds only when the 
SNR and INR increase to infinity. As to the present 
case, we show in Proposition [3] that the rate pair 
iRl,R2) = {I{Xi,X2,X3;Yi\Hi),0) is achievable 
when I{Xi,X2,X3;Yi\Hi) < /(Xi; ^21^2, ^3, ^2) 
holds. In the following we show that this implies an 
unbounded capacity gain over the no-feedback case for 
Rayleigh fading on the VSI regime. 

Let Pi = P2 = P3 = SNR, Let an, 013,^ (122, 023, 
0-31, 0.32 be constants, and let 012 = 0128 N R^ , 021 = 
a2iSNR^ . Note that under these definitions 

INR12 = a?2A = al2SNR^'^SNR = a^SNP'' 
INR21 = a2iP2 = a2iSNR''. 

Now consider the condition I{Xi, X2, X^-^YilHi) < 
I{Xi;Y2\X2, X3, H2)- Using the above definitions we 
obtain 



E 



-^[log2{l + ali\Uii\^SNR 

+ali I U21 l^SNR"" + all \ U31 \^SNR) } 

< E^^ {log2 (1 + al2\Ui2fSNR'') } . 

Taking SNR — 00 and restricting a > 1 and 6 > 1 we 
arrive to the equivalent relationship 

Ej^^{log2 {ali\U2i\^SNR-)] 

<Ej^^{log2 {al2\Ui2\^SNR')}, 

which requires b > a. When this holds, the asymptotic 
sum-rate (we consider only the maximal Ri when R2 = 
0) is given by 

Cm™''(^2=0,5iVi?,a,6) 
= IiXi,X2,X3;Yi\Hi) 
= E^^[log2{l + ali\Uu\^SNR 

+ali I U21 1'^SNR" + all \ U31 {"^SNR) } 



SNR^oo 



E 



^^{log2 {ali\U2i\^SNR-)]+0{i 



= alog2SNR + 0{l), 

where 0(1) means that for some SNR large enough, the 
term is bounded by a constant, see, e.g. Ii58il . Next, we 
consider the sum-rate with feedback only to the relay, 
starting with the VSI regime. Recall that the same sum- 
rate is achieved without feedback when relay reception 
is good in the sense that the channel coefficients satisfy 
ifTTl Eqns. (8)]. Consider first the VSI condition ([3b]): 
I{X2,Xr,Y2\Xi,H2) < I{X2]Yi\Hi). Writing this 



explicitly we obtain 



E,-. <^ logo 1 + 



a 



lAU2i\'^SNR'' 



' l + ali\Uii\'^SNR + ali\U3i\'^SNR 
> Ej^^{log2 (1 + al2\U22?SNR + alal^Jsal'SA^i?)}, 

which, as SNR — 00, becomes 

E^^{ log2 {{al2\U22? + al2\U32?)SNR)] 
<E^^{log2 {ali\U2i\''SNR'')] 

-E^^ {log2 {{ali\Uii\'' + ali\U3i?)SNR)} . 

This inequality holds asymptotically when a > 2. 
Similarly we can show that /(Xi, X3; Y1IX2, < 
I{Xi- Y2\H2) holds for SNR 00 when 6 > 2. 

Recall that at asymptotically high SNR and INR, the 
VSI regime is defined as a > 2 and b > 2 (see lISTll . 
ll26l . We thus conclude that with feedback only at the 
relay, the maximal achievable sum-rate at asymptotically 
high SNR in the VSI regime is 

C^^JSNR,a,b) 
= /(Xi, X3; Yi\X2, Hi) + I{X2, X3; y2|^i, i^2) 
= E^^{ log2 (1 + ali\Uii\'^SNR + alipsil"^ S N R)^ 

Ej^^{log2 (1 + al2\U22\^SNR + al2\U32\^ S N R)} 

E^^[log2{{aji\Uu\^ + ali\U3if)SNR)} 

+E^^{log2{{al2\U22\^ + al2\U32\^)SNR)] 
= 21og2 SNR + 0(1). 

Comparing the sum-capacity with and without feedback 
to the transmitters we observe that in VSI 



+ 

SNR^oo 



c 



FB-Tx+relay 



{R2 = 0,SNR,a,b) 



C^^JSNR,a,b) 



a 
2' 



We conclude that adding feedback links from each 
receiver to the its corresponding transmitter allows an 
unbounded rate gain in the VSI regime. This follows 
directly from our capacity results. 



VII. ICRs WITH Partial Feedback at the Relay 

In this section we study the scenarios in which only 
partial feedback is available at the relay. We consider the 
case where feedback is available only from Rxi, the case 
where feedback is available only from Rx2 is symmetric. 
This scenario is described in Fig. |7] 
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Fig. 7: The interference channel with a relay and feed- 
back only from Rxi to the relay. The 'D' block repre- 
sents a single-symbol delay. 

A. Partial Feedback in the Very Strong Interference 
Regime 

First, we characterize the capacity region of the ICRF 
in the VSI regime for the case where the relay receives 
feedback only from Rxi, i.e, y\^-^ and h}^^ are avail- 
able at the relay at time i prior to transmission. In 
this scenario, the CSI at the relay is represented by 
H_ = {Hi3,H23,Hi) G = ^. Thus, the encoder at 
the relay in (|2]) in Definition [T] is replaced by 

X3,^ = ti(yi:i''y3:i''%'l'^23'l'^M ) e ^' (39) 

i = 1,2, ...,n. The other definitions remain unchanged, 
as described in section Next, we have the following 
theorem: 

Theorem 3. Consider the fading ICRF with Rx-CSI. 
Assume that the channel coefficients are independent 
in time and independent of each other s. t. their phases 
are i.i.d. and distributed uniformly over [0, 27r). Let the 
additive noises be i.i.d. circularly symmetric complex 
Normal processes, CAA(0, 1), and let the sources have 
power constraints E||Xfcp} < P^, k G {1,2,3}. 
Assume that there is only one noiseless feedback link 
— from Rxi to the relay ( see Fig. If 

I{Xi,X3;Yi\X2,Hi) < mm{l{Xr,Yi,Y3\X2,X3,H), 

I{Xr,Y2\H2)} (40a) 

I{X2,X3;Y2\Xi,H2) < I{X2;Yi\Hi), (40b) 

where the mutual information expressions are evaluated 
with Xk ~ CJ\f{0, Pk),k £ {1,2,3}, mutually inde- 
pendent, then the capacity region is given by all the 
nonnegative rate pairs s.t. 

Ri<I{Xi,X3;Yi\X2,Hi) (41a) 
R2<I{X2,X3;Y2\Xi,H2), (41b) 

and it is achieved with X^ ~ CJ\f{0, Pk),k E {1,2,3}, 
mutually independent and with DF strategy at the relay. 



I) Proof of Theorem ^ The proof consists of the 
following steps: 



We obtain an outer bound on the capacity region 
using the cut-set bound. 

We show that the input distribution that maximizes 
the outer bound is zero-mean, circularly symmetric 
complex Normal with channel inputs independent 
of each other and with maximum allowed power. 
We derive an achievable rate region based on DF 
with partial feedback at the relay, using codebooks 
generated according to mutually independent, zero- 
mean circularly symmetric complex Normal input 
distributions. 

- We derive an achievable rate region for decod- 
ing at the relay using steps similar to d Sec. 
4.D]. 

- We obtain an achievable rate region for de- 
coding at the destinations by decoding the 
interference first, while treating the relay signal 
and the desired signal as additive i.i.d. noises, 
followed by using a backward decoding scheme 
for decoding the desired message. 

We derive the VSI conditions which guarantee that 
decoding the interference first at each receiver, does 
not constrain the rate of the other pair. 
We obtain conditions on the channel coefficients 
that guarantee that the achievable rate region co- 
incides with the cut-set bound and thus it is the 
capacity region of the ICR with partial feedback in 
the VSI regime. 



We follow steps similar to the case in which full feed- 
back is available at the relay, so we only provide a sketch 
of the proof. 

a) An Outer Bound: An outer bound on the capac- 
ity region is given by the cut-set bound in Q. Following 



similar steps as in section |IV-A1| and Appendix |Aj we 
conclude that the outer bound is maximized by mutually 
independent, zero-mean, circularly symmetric complex 
Normal channel inputs with maximum allowed power. 

b) An Achievable Rate Region: The code construc- 
tion and encoding process are similar to sections IV-A2a| 
and IV-A2b Hence, following similar steps as in ||2l 
Sec. 4.D], we conclude that an achievable rate region 
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for decoding at the relay is given by 

'^Relay Decoding 

Ri < /(Xi ; n , I ^2 , , H) (42a) 
R2 < /(X2 ; n , I ^1 , ^3 , H) (42b) 

Ri+R2< /(Xi,X2;yi,y3|^3,l)}. (42c) 

At the destinations, Rxi can decode the interference if 
R2<I{X2;Yi\Hi), (43a) 

and Rx2 can decode the interference if 

Ri<I{Xi-Y2\H2). (43b) 

Thus, decoding the interference first, we obtain an 
achievable rate region for decoding at the destinations: 



7^; 



Destination Decoding 



(i?i,i?2) e^H^ : 
Ri<mm{l{Xi,X^-Yi\X2,Hi)J{Xi-Y2\H2)} (44a) 
R2 < min { /(X2 , X3 ; y2 1 , #2) , /(X2 ; Fi I #1 ) }| .(44b) 



Hence, an achievable rate region for the ICR with partial 
feedback is given by 

^Achievable = ^Relay Decoding H ^Destination Decoding- (^5) 

c) The Capacity Region: Next, we should guaran- 
tee that decoding the interference does not constrain the 
rates at the destinations, this is satisfied if 

iTAn{l{Xi-Yi,Y^\X2,X^,H)J{Xi,X^-Yi\X2,Hi)] 
<I{Xi-Y2\H2) (46a) 

min {/(X2; Fi, YalXi, X3, t), /(X2, X3; y2|^i, ^2)} 
< /(X2;yi|^i). (46b) 

Note that as the channel inputs are mutually 
independent, we obtain that I{X2;Yi\Hi) < 
I{X2;Yi,Y3\Xi, X3, H). Hence, the conditions in 
( |46l ) can be reduced to 

mm{l{Xr,Y,,Y3\X2,Xs,H),I{Xi,X-y,Yi\X2,Hi)} 
<I{Xi-Y2\H2) (47a) 
I{X2,X^-Y2\Xi,H2) < /(X2;li|#i). (47b) 

Finally, in order to achieve capacity, we should guar- 
antee that, whenever the destinations can reliably decode 



their messages, the relay can decode both messages 
reliably. This can be done if 

IiXi,X3;Yi\X2,Hi)<I{Xi;Yi,Y3\X2,X3,H) (48a) 
/(X2,X3;y2|^i,^2) < IiX2;YuY3\Xi,X3,H){4Sh) 
I{Xi,X3;Yi\X2,Hi) 

+IiX2,X3;Y2\Xi,H2) < IiXuX2;Yi,Ys\X3,mSc) 

Recall that the channel inputs are independent, hence 
when ( |47b 1 holds, (48b]) is always satisfied since 



I{X2,X3;Y2\X^,H2) < /(X2;yi|^i) 

< IiX2;Yi,Y3\X3,H) 

< I{X2;Yi,Ys\Xi,X3,H). 

Similar arguments show that when (47b) and (48a]) hold, 
( |48c[ ) is always satisfied: 

I{Xi,X2;Yi,Ys\Xs,H) 

= I{X2;Yi,Y3\Xs,H) + I{Xi;Yi,Y3\X2,X3,H) 
> I{X2,X3;Y2\Xi,H2) + I{XuX3;Yi\X2,Hi). 
Therefore, if ( 47b 1 holds, ( |48a[ ) is enough to guarantee 



reliable decoding at the relay (i.e., (42 1 is satisfied). 



Finally note that by combining ( 147] ) with ( |48a| ) we 
obtain conditions which coincide with ( l40] ) and under 
these conditions ( |45] ) specialize to (]4T]). Comparing with 
the cut-set bound in (|5]), we conclude that if ( l40] ) holds, 
the achievable rate region ([41]), coincides with the cut-set 
bounds and hence it is the capacity region. ■ 

2) Ergodic Phase Fading: When the channel is sub- 
ject to ergodic phase fading, we obtain the following 
explicit result: 

Corollary 6. Consider the phase fading ICR with Rx- 
C SI and partial feedback s.t. y^^^ and are available 
at the relay at time i. If the channel coefficients satisfy 



a\^Pi + 031^3 < min | — 



+ a^,P2 + 032-^3 ' 



'■22^'i 



"12^2 + al2P3 < 



4lP2 



)Pi} (49a) 

l+«2p,„2p' (49b) 
i + a^i-Ti + amir's 

then the capacity region is characterized by all the 
nonnegative rate pairs s.t. 

Ri < log2 (1 + al^P, + al.Ps) (50a) 
R2 < log2 (1 + 4^P2 + al^Ps) , (50b) 

and it is achieved with X^ ~ CM{0, Pk), k G {1, 2, 3}, 
mutually independent and with DF strategy at the relay. 

Proof: The result follows from the expressions 
of Theorem [3] In order to obtain the conditions 
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on the channel coefficients in ( [49| ), we evaluate 
/ {Xi ; Yi , I3 1 X2 , X3 , H_) using mutually independent, 
zero-mean circularly symmetric complex Normal chan- 
nel inputs. This leads to 



I{X,;Yi,Y3\X2,X3,H) 

= E^|log2 {l + Pi{\Hn\'' + \H: 



.(51) 



Next, note that under the phase fading model = 
af^ and |-ffi3p = af^, thus ( |5T] ) can be rewritten as 

I{Xr,Yi,Y3\X2,X3,H) = log2 (1 + Pi(a?i + afg)). 

The rest of the expressions in Theorem |3] have been 
already evaluated for the phase fading model in Corollary 

m ■ 



3) Ergodic 



Rayleigh 



Fading: 



Define 



Uk = {Ukk,U3k),Uk = {Uik,U2k,U3k),k G {1,2}. If 
the channel is subject to ergodic Rayleigh fading, we 
obtain the following explicit result: 

Corollary 7. Consider the Rayleigh fading ICR with Rx- 
CSI and partial feedback s. t. y^{]^ and h\~^ are available 
at the relay at time i. If the channel coefficients satisfy 

Ej^^{log2 (l+a?i|?7ii|2pi+aii|?73i|'P3)} 
< Ec7,„c/,3{log2 (l + (a?i|C/ii|2+a?3|C/i3|2)Pi)} (52a) 
^ { log2 (1 + a?i I ?7ii 1 + ail I C/31 1 2P3) } 



E 

<E^^<;iog2(i+ 

E 



l+al2\U22?P2+al2\U:i2?P^ 
{log2 {l+al2\U22\^P2+al2\U^2\^P^ 

a2ll^21P-P2 



<E^^<;iog2(i+ 



(52b) 



(52c) 



l+a2jC/n|2Pi+a2jC/3i|2p3^ 

then the capacity region is characterized by all the 
nonnegative rate pairs s.t. 

Pi < E^^{log2 (l+a2i|[/n|2Pi+aii|C/3i|2p3)} (53a) 

P2 < %{log2 (l + a22|t^22pP2 + ai2|f/32|'^3)},(53b) 

and it is achieved with X^ ~ CM{0, Pk), k G {1, 2, 3}, 
mutually independent and with DF strategy at the relay. 

Proof: The proof follows similar arguments to those 
used in the proof of Corollary |6] ■ 
4) Comments: 

Comment 25. Comparing to Theorem [TJ we observe 
that in Theorem [3] there is an additional condition in 



( [40| ). This is due to the fact that with partial feedback 
at the relay, the cut-set bound cannot be achieved at the 



destination without guaranteeing reliable decoding at the 
relay. 

Comment 26. For the configuration described in Theo- 
rem [3} then from Proposition [2] it is clear that adding a 
noiseless feedback link, from Rxi to Tx2 (partial Rx- 
opposite Tx feedback) does not enlarge the capacity 
region in the VSI regime. 

Comment 27. Consider the configuration described in 
Theorem [3] with an additional noiseless feedback link 
from Rxi to Txi (partial Rx-corresponding Tx feedback). 
Then, following the same arguments as in Proposition |3] 
we conclude that if 

/(Xi, X3; Yi\X2,Hi) < mill {/(Xi; y2|^2), 

/(Xi;yi,y3|^2,X3,l)}(54a) 
I{Xi,X2,X^-Y2\H2)<I{X2;Yi\Hi), (54b) 

hold, then (Pi,P2) = {Q,I{Xi,X2,X^-Y2\H2)) is 
achievable. Note that ( [54] ) guarantees (40). Hence, when 
partial feedback (only from Rxi) is available at the 
relay, then an additional feedback link from Rxi to Txi 
increases the capacity region in the VSI regime. Figure 
[8] demonstrates the corresponding capacity region. 
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Fig. 8: The capacity region of the ICRF in the VSI 
regime with Rxi -relay feedback and without Rx-Tx 
feedback (the gray area) and the achievable region 
with Rxi -relay and Rxi-Txi feedback (gray and black 
area), when the channel is subject to phase fading and 
Pi = P2 = P3 = 10, an = 0.2, ai2 = 0.27, 021 = 
0.44, a22 = 0.2, a3i = 0.1, a32 = 0.1 and ai3 = 0.3. 



B. Partial Feedback in the Strong Interference Regime 

In this section, we characterize the capacity region of 
the ICR with partial feedback in the strong interference 
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regime. We consider the case in which feedback is 
available only from Rxi. 

Theorem 4. For the scenario of Theorem |3] if the 
channel coefficients satisfy 

I{XuX^;Y2\X2,H2)< I{Xi ■,Y^,Ys\X2,X^,H) (55a) 
/(X2, Xs; ^i) < /(X2; Yi,Y3\Xi,X3,H) (55b) 

IiXuX2,X3;Y2\H2)<IiXi,X2;YuY3\X3,H) (55c) 
IiXi,X3;Yi\X2,Hi)< I{Xi ■,Y2\X2,H2) (55d) 
IiX2,Xs;Y2\Xi,H2)<IiX2;Yi\XuHi), (55e) 

where the mutual information expressions are evaluated 
with Xk ~ CJ\f{0, Pk),k G {1,2,3}, mutually inde- 
pendent, then the capacity region is given by all the 
nonnegative rate pairs s.t. 

Ri < I{X^,Xs-Y^\X2,Hi) (56a) 
R2 < I{X2,X3;Y2\Xi,H2) (56b) 
Ri+R2< mm{l{Xi,X2,X3;Yi\Hi), 

I{Xi,X2,X3;Y2\H2)},(56c) 

and it is achieved with X^ ~ CM{0, Pk), k G {1, 2, 3}, 
mutually independent and with DF strategy at the relay. 

1) Proof of Theorem ^ The proof consists of the 
following steps: 

• From the ICRF we obtain two component channels: 
the first is the MARC with feedback (MARCF) 
which is a MARC whose message destination is 
Rxi and the relay receives feedback only from 
Rxi- The MARCF is defined by equations (fTa]) and 



( [Tc| ). The second is the partially enhanced MARC 
(PEMARC) defined as a MARC whose message 
destination is Rx2, while the relay receives feedback 
from Rxi. The PEMARC is defined by equations 
([T]) and {y\~i , /il 7) denotes the available feedback 
at the relay at time i in both components. Note 
that contrary to Theorem |2j in the present case the 
component channels are not symmetric. 
We obtain the conditions on the channel coefficients 
s.t. the capacity of the MARCF and the PEMARC is 
achieved with DF at the relay. We show that for each 
component, capacity is achieved with zero-mean, 
circularly symmetric complex Normal channel in- 
puts. 

We show that the same coding strategy at the 
sources and at the relay achieves capacity for both 
the MARCF and the PEMARC simultaneously. 
We therefore provide an achievable rate region for 
the ICR with partial feedback as the intersection 
of the capacity regions of the MARCF and the 
PEMARC. 



• We show that when the conditions for SI are satis- 
fied, the intersection of the capacity regions of the 
MARCF and the PEMARC contains the capacity 
region of the ICR with partial feedback. 

• We conclude the capacity region of the ICR with 
partial feedback in the SI regime, to be the inter- 
section of the capacity regions of the MARCF and 
the PEMARC. 

• We explicitly characterize the SI conditions for the 
ICR with partial feedback. 

a) An Achievable Rate Region: Recall the achiev- 
able rate region for decoding at the destination as in The- 
orem |2] Define a as in section V-Al and let CMARCF(a) 
and CpEMARc(a) denote the capacity regions of the 
MARCF and the PEMARC, respectively. Moreover, let 
ti(i?i,i?2) and t2{Ri,R2) denote the coding strategy 
for the MARCF and the PEMARC, respectively. From 
the derivation in Appendix |B] it follows that when only 
partial feedback is available at the relay, achievable rate 
regions for the MARCF and the PEMARC obtained with 
DF at the relay are given by 



^MARCF/PEMARC 

= !^{Ri,R2)eml : 

Ri<mm{l{Xr,Yi,Y3\X2,X3,H), 

I{Xi,X3;Ym\X2,Hm)} (57a) 

R2 < mm{l{X2;YuY3\X2,Xs,H), 

I{X2,X3;Ym\Xi,Hm)} (57b) 

Ri + R2< mm{l{Xi,X2;Yi,Y3\X3,K), 

IiXi,X2,X3;Ym\Hm)}], (57c) 



where m = 1 for the MARCF and m = 2 for the 
PEMARC, and decoding at the relay at block b is done 
using rule ([6]) without considering y2(&), and X^ ~ 
CAf{0,Pk),k £ {1,2,3}, mutually independent. Let 
t£)p{Ri, R2) denote the coding scheme with mutually 
independent complex Normal inputs, achieving rates Ri 
and R2 in each component channel. Following steps 
similar to Appendix [Aj we can show that in order for 
iDF{Ri, R2) to achieve the capacity of each component 
channel, we should guarantee that the relay decodes both 
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messages reliably, i.e., we should guarantee that 

max {l{Xi,Xr,Yk\X2,Hk)} 

<I{Xr,Yi,Y3\X2,X3,H) 

ax \l{X2,Xs;Yk\Xi,Hk)} 
1,2} L J 

</(X2;yi,y3l^i,^3,^) 

ax \l{Xi,X2,X3;Yk\Hk)} 

1,2} J 

<I{Xi,X2;Yi,Ys\X3,H). 



max 

ke{l,2} 



max 

fe6{l,2} 



(58a) 
(58b) 
(58c) 



Note that if ( [58) holds then the capacity regions of the 
component channels are given by: 

Cmarcf/pemarc (a) 

{Ri,R2)eml: 

Rl < /(Xi, X3; Ym\X2, Hra) (59a) 
R2 < IiX2, X3; Ym\Xi,Hra) (59b) 

i?i + i?2 < /(Xi , , X3 ; y„ I ) I , (59c) 

where m = 1 for the MARCF and m = 2 for 
the PEMARC, and they are achieved with X^ ~ 
CAA(0, Pfc), k G {1, 2, 3}, mutually independent and with 
DF strategy at the relay. 

Note that when the conditions in ( |58l ) hold, by fol- 
lowing similar steps as in the proof of Proposition [1] 
we conclude that the same coding strategy achieves ca- 
pacity for both component channels simultaneously. Let 

^MARCF(a,tl(i?l,ii2)) and 7^PEMARc(a,^2(^l,-R2)) 

denote the achievable rate regions of the MARCF and 



the PEMARC, respectively. Hence, when ( [58| ) holds 
and by choosing ti = t2 = t£)p, any achiev- 
able rate pair {Ri,R2) G TZmarcf t df {Ri, R2)) n 
T^PEMARC (a, topiRi, R2)) is also achievable in the ICR 
with partial feedback. Thus, if ( [58] ) holds then an achiev- 
able rate region for the ICR with partial feedback is given 
by 

T^ICRf{^, top) = '7^MARCF(a, top) n '7^PEMARc(a, top) 
= CMARCF(a) n CpEMARc(a) 

^ CicRF(a). (60) 
b) Converse: The proof of the converse follows 



conclude that in the SI regime 

CicRF(a) = CMARCF(a) n CpEMARc(a). (61) 

Recall that when decoding at the relay does not constrain 
the rates, then CMARCF(a) and CpEMARc(a) are given in 
( |59l ). Next, we determine the SI conditions in the ICR 
with partial feedback. Note that since CMARCF(a) and 
CpEMARc(a) in ( |59l ) are achieved with tDp{Ri, R2), for 
the rest of the proof we only consider mutually inde- 
pendent, circularly symmetric complex Normal channel 



inputs with zero mean. Recall the converse proof in V-A2 



and consider any rate pair (i?i,i?2) G CicRF(a). If Rxi 
can decode mi from the signal 

yi = hii • xi + h2i • X2 + hsi • X3 + zi, 

then it can create the signal 

y[ = h2i • X2 + hsi • X3 + zi, 

from which it can decode m2 by treating hsi • X3 as 
additive i.i.d. noise0if 

R2 < I{X2;Yl\Hi) = R'2, 
and similarly Rx2 can decode mi if 

Rl < I{Xr,Y^\H2) = R[. 

In order to guarantee that decoding both messages at 
each receiver does not reduce the capacity region we 
should require: maxiii < R[ and maxi?2 < ^2- "^^^^ 
is satisfied if 

sup y{Xi, 

f{Xi,X2,X3) 



Yi\X2, Hi 

(a) 



^]<I{Xi-X\H2) 



sup 

f{Xi,X2,X3) 



I{Xi;Y2\X2,H2) (62a) 
I{X2,X3;Y2\Xi,H2)}<I{X2;Yl\Hi) 

= I{X2;Yi\Xi,Hi). (62b) 

Note that all the above mutual information expressions 
are evaluated using the same channel input distribution. 
Here, (a) follows from the fact that the l.h.s. of ( [62] ) is 
maximized by X^ ~ CA/'(0, Pk),k G {1, 2, 3}, mutually 
independent and independent of the channel coefficients. 



Thus, when ( [58) holds, the conditions for the strong 
interference are given by 

I{Xi,X3;Yi\X2,Hi) < I{Xi;Y2\X2,H2) (63a) 

I{X2,X3;Y2\Xi,H2) < I{X2;Yi\Xi,Hi). (63b) 

We conclude that if the conditions for reliable decoding 



similar arguments to those used in section [V^ Note ^t the relay ([58) and the conditions for SI ([53) are 



that in the SI regime, both receivers can decode both 
messages without reducing the capacity region. Thus, 
any achievable rate pair (i?i,i?2) G CicRF(a) is also 
achievable in the component channels, i.e., CicRF(a) ^ 
CMARCF(a) nCpEMARc(a). Thus, combined with ( [60) we 



satisfied, then the capacity region is given in ( [61) where 
the rate expressions for the component channels are 



given in (59 1. 



Note that for this step we use the fact that the capacity-achieving 
codebooks are generated independently. 
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c) Simplification of the Capacity Region: Next, 



note that when ( 63 1 is satisfied, we obtain 



I{Xi,X:i-Yi\X2,Hi) < I{Xi;Y2\X2,H2) 

< IiXi,X3;Y2\X2,H2) 
I{X2,X3;Y2\Xi,H2) < IiX2;Yi\XuHi) 

< I{X2,X3;Yi\Xi,Hi), 



hence, (61 1 can be reduced to 



i?i < /(Xi,X3;yi|X2,Fi) (64a) 
R2 < I{X2,X3;Y2\Xi,H2) (64b) 
Ri+R2< mm{l{Xi,X2,X3;Yi\Hi), 

I{X^,X2,Xs;Y2\H2)}, (64c) 

and dSSll can be reduced to 



(65a) 
(65b) 

(65c) 



IiXi,X3;Y2\X2,H2) 

<IiXr,Yi,Y3\X2,X3,H) 
IiX2,X3;Yi\Xi,Hi) 

<IiX2;Yi,Y3\Xi,X3,H) 

max \l{Xi,X2,Xr,Yk\Hk)} 
fce{i,2} I ' 'J 

<I{Xi,X2;Yi,Ys\Xs,H). 

Next, note that when ( |63a| ) and (65ai hold, we obtain 

I{Xi,X2,Xs;Y^\Hi) 

= IiX2;Yi\Hi) + I{Xi,X3;Yi\X2,Hi) 

< I{X2;Yi\Hi) + I{Xi,X3;Y2\X2,H2) 

< I{X2;Yi,Y3\X3,H) + I{Xi;Yi,Y3\X2,X3,H) 
= IiXi,X2;Yi,Y3\X3,H). 

Therefore, if (63 1 holds, ( |65c| ) reduces to 

I{X^,X2,X3;Y2\H2) < I{Xi,X2;Y^,Y3\Xs,H).i66) 

Observe that in the SI regime with partial feedback, 
reliable decoding at the relay does not constrain the sum- 



rate in the MARCF. In the PEMARC, however, (66 1 



constrains the sum-rate to guarantee reliable decoding 
at the relay. Hence, decoding at the relay imposes an 
additional condition on the channel coefficients in the 
PEMARC onto those required in the MARCF. Note 



that ( [64| ) gives ([56]) and by combining ( |63) with ( |65a| ), 
( |65b| ) and ( |66l ), we obtain the conditions in (55 1. This 
completes the proof. ■ 
2) Ergodic Phase Fading: Define 6 = 
{811,613,621, 023)- When the channel is subject to 
ergodic phase fading, we obtain the following explicit 
result: 



Corollary 8. Consider the phase fading ICR with Rx- 
CSI and partial feedback s.t. y^^^ and h]~i are available 
at the relay at time i. If the channel coefficients satisfy 



a?2^i + ai2^3 < + a23)Pi(67a) 
aliP2 + al,P3 < (ail + ai3)^2(67b) 
log2 (l+a?2Pi+ai2^2+a^2^3) < 



log2[l+{^Pk-ial, + al,)) 
^ k=l 

+P1P2 • (a?ia23 + 0^3021 



-2 • 013021011023 • cos(6'i3 + 6*21 

-011 -^23))) I (67c) 

o?iPi + oiiP3 < . f 'f' (67d) 
i + O32P3 

012^^2 + oi2P3 < , °''f' , (67e) 

i + Ogj^J-^ 



then the capacity region is characterized by all the 
nonnegative rate pairs s.t. 



Ri < log2 (1 + a?iPi + o^iP3) (68a) 
R2 < log2 (1 + 022^2 + al2P3) (68b) 
R1+R2 < min I log2 (1 + ofiPi + oiiP2 + aiiP3) , 

log2 (1 + ofaPi + 022P2 + 022P3) }, (68c) 



and it is achieved with X^ ~ CJ\f{0, Pk), k G {1, 2, 3}, 
mutually independent and with DF strategy at the relay. 

Proof: The result follows from the expressions of 
Theorem |4l ■ 

3) Ergodic Rayleigh Fading: Define 
tJk = {Ukk,U3k),Uf, = {Uik,U2k,U3k),k E {1,2}, and 
Ui = (f/i2,C/32), U2 = {Uu,Ui3),U3 = {U2UU31), 
Ua = {U2UU23), f75 = (^7ll,f/21,t/l3,C/23)- If the 
channel is subject to ergodic Rayleigh fading, then we 
obtain the following explicit result: 

Corollary 9. Consider the Rayleigh fading ICR with Rx- 
CSI and partial feedback s.t. y\~^ and h^i^i are available 
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at the relay at time i. If the channel coefficients satisfy 
E^^{ log2 (1 + al^\Ui2\''Pi + al^\U^2?P3)} 

< Ej^^{log2 (1 + al^\Uu\^Pi + a?3|[/i3pPi)}(69a) 
E^^ { log2 (1 + a^i I ?72i |'P2 + ail | C/31 1 'Ps) } 

< Ef^^{log2 (1 + al^\U2i\^P2 + ai3|t/23|'P2)}(69b) 
E^^{ log2 (1 + a?2|f/i2|'Pi + 022 1 ^22 1 



<E^^|log2 (^l+(^YlPk-{al,\Uki\^ 

+al3\Uk3\') 

+ (Pi P2 • (a?i I I f^23 1 ' + «?3 1 ?7i3 pail I ^721 P 

-2 • 9^e{ai3C/i3a2it/2iaii?7ria23C/2*3})) ) \ (69c) 



and 



1 + afiPi + aiiPa < 



e "^2^1 £^1 



1 + ai2P2 + ai2P3 < 



l+aiiP3 



e "ii^2 



(69d) 



,(69e) 



l+aliP3 



'1 

then the capacity region is characterized by all the 
nonnegative rate pairs s.t. 

Ri < Ej^^{log2 (l + a?i|C/ii|2pi 

+0^1 1 C/31 1 2P3)} (70a) 

P2 < %,{log2 (l + ai2|f^22|'P2 

+0321^^32! 'Pa)} (70b) 
Pi + P2 < ^min^ {e^J log2(l + aj,,\UikfPi 

+4k\U2kfP2 + a2^|C/3fc|'P3)}}.(V0c) 

and it is achieved with Xk ~ CA/'(0, Pk), k € {1, 2, 3}, 
mutually independent and with DF strategy at the relay. 

Proof: The proof follows similar arguments to those 
used in the proof of Corollary [8] ■ 

C. Comments 

Comment 28. Comparing partial feedback (Corollary [8]l 
with no-feedback iTTl Theorem 2], we note that the rate 




Fig. 9: The geographical position in the 2D-plane in 
which the VSI conditions hold for the ICR subject to 
phase fading. The black region shows the location of 
the relay for ICRs without feedback in which DF at the 
relay achieves capacity at VSI. The union of the black 
and dark gray regions shows the location of the relay for 
ICRFs with partial feedback, only from Rxi to the relay, 
in which DF at the relay achieves capacity at VSI. The 
union of the black, dark gray and light gray corresponds 
to ICRF with feedback from both receivers to the relay. 
The scenario parameters are detailed in Comment |6[ 

constraints at the destinations are the same. Also note 



that a G Pi n P2 guarantees ( |67a| )-( [67c| ), hence as in 
Comment |5] feedback allows obtaining capacity char- 
acterization for a larger set of channel coefficients, and 
there are scenarios in which feedback strictly enlarges 
the capacity region (e.g., when 023 is very small). 

Fig. |9] was created using the same parameters as 
those used for generating Fig. |2j see Comment |6] for 
details. The figure demonstrates most clearly the benefits 
of combining feedback with relaying for interference 
management. Observe that without feedback, achieving 
capacity in the VSI regime requires the relay to be close 
to the transmitters, while partial feedback and moreover 
full feedback allow achieving capacity for a significantly 
larger geographical region. 

Comment 29. Note that if we assume a unidirectional 
noiseless cooperation link from one of the receivers to 
the other one, then the conditions of the SI and the VSI 
regime can not be satisfied. Without loss of generality 
assume a noiseless cooperation link from Rxi to Rx2, 
then the achievable rate at Rx2 will always exceed the 
achievable rate at Rxi. Hence decoding the interference 
at Rxi will always decrease the capacity region. The 
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same conclusion also holds for decoding both messages 
at Rxi- Thus if there is a unidirectional noiseless coop- 
eration link from one of the receivers to the other one, 
then the SI and the VSI conditions can not be satisfied. 
Note that this conclusion does not hold for the scenarios 
where the link between the receivers is noisy or if the 
receiver first compresses its channel observations prior 
to forwarding them to the other receiver (see |[32]| and 

mi 



small number of relay stations can optimally assist sev- 
eral nodes simultaneously. These observations support 
the deployment of relay nodes to assist in managing 
interference in practical wireless systems such as cellular 
and WiFi networks. We note however, that additional 
research, especially on non-fading scenarios is still re- 
quired to obtain a complete assessment of cost-benefit 
tradeoff. 



VIII. Conclusions 

In this paper we characterized the capacity region 
of the fading interference channel with a relay for 
different feedback configurations. The capacity region 
was characterized explicitly for the phase fading and 
Rayleigh fading scenarios in both SI and VSI regimes. 
We showed that the capacity is achieved with zero-mean, 
circularly symmetric complex Normal channel inputs, 
independent of each other with all transmitters using 
their maximum available power. It was also shown that 
when feedback is available at the relay, then the best 
strategy for the relay in these regimes is to decode both 
messages and forward them to both receivers and thus 
assist both receivers simultaneously. We showed that 
with such a strategy at the relay, when VSI occurs the 
ICRF behaves like two parallel relay channels. We also 
showed that when SI occurs, the ICRF behaves like 
two EMARCs and the same coding strategy achieves 
capacity for both simultaneously. We next showed that 
if feedback from both receivers is available at the relay, 
then additional feedback from each receiver to its oppo- 
site transmitter provides no further improvement to the 
capacity region. However, additional feedback links from 
each receiver to its corresponding transmitter can enlarge 
the capacity region. By comparing the scenario where 
there is partial feedback (from one of the receivers only) 
or full feedback (from both receivers) at the relay, versus 
the scenario with no feedback at all, we showed that 
partial feedback and moreover full feedback increase the 
range of the channel coefficients which allow achieving 
capacity in both VSI and SI regimes significantly. With 
no feedback however, the relay reception must be good 
in order to achieve capacity (Recall fV. Theorem 6]: in 
the relay channel under the phase fading assumption, DF 
achieves capacity when the relay is closer to the source 
than to the destination). 

The fact that the capacity achieving channel inputs 
are mutually independent allows a relatively simple 
integration of relaying into existing wireless networks. 
Also note that since the relay can be optimal for both 
communicating pairs simultaneously, then a relatively 
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Appendix A 
Maximizing Distribution for the Cut-Set 
Bound 

A. The Upper Bound on Ri 

Starting with the upper bound on Ri, we first consider 
/(Xi; Yi,Y2,Y^\X2,X?,,H_)- Note that by fixing the side 
information H^ = h, we obtain 

hiYi,Y2,Y3\X2,X-i,H = h) 

= h{hiiXi + Zi, huXi + Z2, 

hi3Xi + Z3\X2,Xs,H = li). (A.l) 

Define H ^ {Hn, H12, Hysf ,Z ^ (^1,^2,^3)^. 
Following these definitions we define (11,12,13)^ = 
a ■ Xi + Z. For X = {Xi, X2, X3), zero-mean, define 
Ci = E{XX^}. Letting a^- = E[XiX*] we get 



Xi' 

Ci^E^ X2 [XIX^,X*^ 

X3_ 

< -\2^l ^2^2 "^2^3 
_A.3Jil A3A2 A3A3 

-Pi ai2 ai3 

"21 P2 "23 
,"31 "32 -P3 
til 

t21 T22 



(A.2) 



(A.3) 
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where tn = Pi and T22 is 2 x 2 and p.d.. Next we • (a) follows from ( |A.1[ ). 

obtain • (b) follows from Lemma |2] which show that 

I(X - Y Y Y\X X H) h{Yi,Y2,Y3\X2,X3) is maximized by jointly cir- 

^ ^' ^' ^' ^' ^' ^' — ^ cularly symmetric complex Normal RVs with 

= E - < /ifYi Y2 I3IX2 X3 h) mean and same covariance matrix as 

-I ' ' ' {Yi,%,%,X2,X3). 

• (c) follows from the definition of Yi , 5^2 , ^3 , H and 



-/i(yi,y2,n|Xi,^2,X3,/i) 



z. 



(n\ ( - - ~ 1 • (d) follows from the fact that Z is independent of 

^ ^ E^|/i(yi,y2,n|X2,^3,/i)-M^i,^2,^3)| Xfc,yte {1,2,3}. 



1^ • (e) follows from |l35l Sec. VI] which shows that 

< log2 ^(vre)^ det (cov(yi, y2, ^3|-^2; -^^3, Zi))^ the conditional covariance matrix of jointly complex 

^ normal RVs is given by the Schur complement of 

— log2(vre)'^ I T22 in the covariance matrix Ci. 

J • (f) follows from Ii38i Proposition 8.1.2 and Lemma 

= E/v| logo f det (cov(yi,y2,y3|X2,X3,^))^l 8.2.l£3 

V V 1, 2, 31 2, 3,_;;;j . (g) follows from th^definition A ^ ^llH^lT22^ 

(c) f ( J I /n V ryw V • follows from [46, Lemma 3.1] and from ll37l 



(e) 



^ f, ( ^ I r,i^^ • (h) follows from [46, Lemma 3.1] a 

E^l log2 ( det (cov(H . Xi + Z|X2, X3, /,)) j | ^^^^^^^ ^ ^ _^ ^^^^^^^ 4^ 

( , _ • (i) follows from the range of p, as given in ||46l 

%| log2 (det(cov(H-Xi|X2,X3,/i) Lemma 3.1]: p G [0,1] and from [37. Theorem 

^ 7.7.2 and Theorem 7.7.4] which state that since 

+cov(Z|X2,X3,/i))) \ (l-/52)tn < til then det(I + H(l-p2)t^^H^) < 

^ det(I + Htiih^). 

E^i log2 [a&X, (I + H • cov(Xi|X2, X3) • H-^)^ I Next, note that ( |A3| ) does not depend on 012, 013 or 

. a23 and it can be achieved with equality from ( A.4| ) by 

E^ <^ Iog2 ( det (I setting a\2 = ai3 = 0, irrespective of the value of 

^ ^ 023, which can also be set to zero. We also note that 

+H • (til — t^T^^t2i) • H^)^ I (A 4) since log2(a;) monotonically increases with respect to 

) \ X, then I{Xi ; Yi , y2 , y3 1 X2 , X3 , fP) is maximized when 



(Z) E / lo (det fl achieved with equality if Xi,X2,X3 are jointly 

H_y °S2 \^ ^ V Normal. As these variables are uncorrelated, they are also 

1 _ii H \ \ independent. In conclusion, I(Xi; Yi, y2, ^3 1 -^^2, -'^s, ^) 

+H • tl^{l — t^]^-t2iT22''T22''t2itii^)t|i • H j j > jg maximized by mutually independent, circularly sym- 



C J J N metric complex Normal channel inputs with zero mean. 

= E^l log2 (det (I + H • tfi(l - AA^)tfi • H^)) [ Next we consider /(Xi, X3; yi|X2, ^1). Following 

the same arguments as the previous rate bound, note that 



(/i) f / 1 1 

< E^l log2 (det (I + H • tfi • (1 - p2) . . 

< E^|log2(det(l + H-tn-H^))|. = M^n^i + ^31^3 + ^i|^2, ^1 = /ii). (A.6) 



h{Yi\X2,Hi = hi) 



Thus, by using [|38l Fact 3.7.19fj we get the following Define 
inequality: 



yi ^ i^ii^i + ^31^3 + Zi, (A.7a) 



/(Xi;yi,y2,y3|X2,X3,^) < 

"IT Ji„ ( A I D l\ u l2iiL7 l2iitr |2\\ I / A '"Oiven a p.d. matrix A, is also a p.d. matrix and A can be 

E^|log2 [l + Fi[\Hii\ + |i/i2| + |i^i3| (A.5) ^^.^^^^ ^ ^ ^^^^^ j3 ^^^^ ^ ^^^^.^ 

" |37I Thieorem 7.7.2]: Given two Hermitian matrices, A, B, if 
In the above transitions, B ^ A then T^BT ^ T^AT. Tiius, I + T^BT ^ I + T^AT. 

|37l Theorem 7.7.4]: Given two matrices, A, B, if B < A then 
'Given x, y G C\ define A = I-xy^. Then, det(A) = 1-x^y. det(B) < det(A). 
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^1 
X2 



E 



X2Y* X2XI 
Til T12 

t22 



Hi 



(A.7b) 



Hence, we bound I{Xi, X^]Yi\X2, Hi) as follows: 

I{Xi,X^-Yi\X2,Hi) 

= W.^^\h{Yi\X2M) - h{Yi\Xi,X2,X:,M 

< E^^ I log2 ( det (cov(li|X2, hi^ 
= E, 



(6) 

< E 



^^^|log2 {Tii-Ti2^^Tl2)^ 



(A.8) 



Thus, we get 

I{Xi,X^-Yi\X2,Hi) 
< E^^{ log2(|//ii|2Pi + HiiHl^ai3 

+H3iHl^a3i + |i^3i|'P3 + 1)}. (A.9) 



Here, (a) follows from the definition of Yi in (A.Val, 



from ( |A.6[ ) and from Lemma |2j and (b) follows from 



the fact that ri*2^i2 = 1^12^ > 0. Next, note that: 
E^^{log2(Tn)} 

= / log2 (|/liipPi + /lii/l3iai3 + /l3i/liia3i 

+ |/i3l|2p3 + l)/^^(/ll)(i/li. 

Hence, if we replace H^i with —H31, the result of the 
integral remains unchanged. This follows as hij's are in- 
dependent complex RVs with uniform phases on [0, 2tt), 
independent of their magnitudes, and therefore the value 
of the integration is the same for all initial phases. Hence, 
following the same technique as in [7, Theorem 8] and 
from concavity of the logarithm function, we can apply 
Jensen's inequality and rewrite the bound in ( A.9| ) as: 



I{Xi,Xs;Yi\X2,Hi)<E^^[log2{Tii)} 

< E^^{ log2(|/fii|'Pi + iHsil^Ps + 1)}. (A.IO) 



As the bound in (A.lOi does not depend on 012,013 or 



a23, then ( |A. 10| ) is achieved with equality from ( |A.8[ ) by 
setting ai2 = 013 = 023 = 0. 



We conclude that the upper bound on Ri in cut- 
set bound is maximized by mutually independent, zero- 
mean, circularly symmetric complex Normal channel in- 
puts, and with all sources transmitting at their maximum 
available power. 

B. The Upper Bound on R2 

Following steps similar to those in section 
|A-A[ we conclude that the mutual expressions 
I{X2;Yi,Y2,Y:,\Xi,X^,H) and /(X2, X3; ^21^1, #2) 
are both maximized by mutually independent, zero 
mean, circularly symmetric complex Normal channel 
inputs. 

C. The Upper Bound on Ri + R2 
First, note that 

h{Yi,Y2,Y3\X3,H = h) = 

h{hiiXi + h2lX2 + Zi, hi2Xi + /l22^2 + Z2, 
hi3Xi+h23X2 + Z3\X3,H = h). (A.ll) 



Define H, X, Z and rewrite Ci from (A.2i as 



H 



X 



Ci 



-f^ll H21 
H12 H22 
His H23 

Xi 
X2 
Zi 

Z2 
Z3 

Til ti2 
^12 *22 



(A. 12a) 
(A. 12b) 
(A. 12c) 
(A.12d) 



where Tn is 2 x 2 and p.d. and t22 = Pj,- Using the 
above definitions we obtain 



/(Xi,X2;yi,y2,i3l^3,D 

= ^J^{Yi,Y2,Y3\X3~h) 

-h{Yi,Y2.Y3\Xi,X2.X3~}^ 

< E^|log2(det(l + H-(Tii 

-ti2t22^tf^) • H^)^ 

< Ej^l log2 ( det (I + H • Til • H^) 



(A. 13) 
-.(A. 14) 
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Thus, we bound I{Xi,X2; Yi,Y2, Y^\X^,H_) as follows: maximum available power, i.e., 



I{XuX2;Yi,Y2,Ys\Xs,H) 

2 



< log2 (l + {^Pi{\Ha\^ + \Hi2\'' + iHisl'')) 
^ 1=1 



+ ((PiP2 - |ai2|')(|^ii|'|^22|' + lii-iil'l^/asl' 

ilTj- \2\ TT |2 I \ rj |2|rj |2 i \ tt |2|rj |2 
+ \Hi2\ \rl2l\ + |-ni2| |-n23| + I-Hisl |il2l| 

+ |^13P|^22P - 2Vi - 2V2 - 2V3)) 

+ai2{HuH2i + H12H22 + H1SH23) 
+a2i{H2iH;, + H22HI2 + //sa^ra)) }, (A- 15) 



where 

1^1 = ^z{HiiH22Hl2H*2^} (A.16a) 

^2 = lHe{//i2//23^1*3^2*2} (A- 16b) 

^3 = 'Kt{HnH2iHl^H*2^]. (A.16C) 
The transitions used in the above derivation are similar to 



those used in section A-A Here, (a) follows from [46, 



Lemma 3.1] and from [37, Theorem 7.7.2]. Following 
the same technique as in [|7l Theorem 8] we obtain 
that replacing Hu,Hi2,Hi3 with -Hu, -Hu, -H13, 
respectively, does not change the expected value in 
( |A.15| ). This is equivalent to replacing ai2 and 021 with 
— ai2 and —021. The above observation can be used to 



express ( A.15 1 as: 



E^l log2(det (l + HTnH^))| 

< eJ log2 (1 + {J2Pii\Hilf + \Hi2\^ + \Hi3\^)) 

^ i=l 



+ {{PiP2-2\ai2\^){\Hii\^\H22\^ 

\2\ TT |2 I \ TT \2\ TT |2 



+ |-f^23| + \H 



12 



21 



I \ TT \2\ TT \2 I \ TT \2\ TT \2 

+ \n\2\ \rl2z\ + |-ni3| |-n2l| 

+ |i^l3|'|^22|' - - 2V2 - 2y3)))},(A.17) 



where (a) follows from the concavity of the logarithm 
function. Next, we have the following proposition: 



Proposition A.l. The expression in ( |A.17| ) is maximized 
when 0L\2 = and when Txi and Tx2 transmit at their 



I log2 ( det (I + HTiiH^) 

E^ log2 (1 + {Y,P^i\Hil\^ + \Hi2\^ + \Hi3\^)) 
^ i=l 

+-Pl-F2(|-ffllP|-f^22p + |-f^llP|-ff23p 



I \ TT \2\ TT \2 I \TT \2\TT |2 

+ \n\2\ \ti2\\ + |-ni2| |-n23| 



\TT \2\TT I 2 

|-ni3| |^2l| 



+ |-f^l3|^|-f^22p 



2^1-21/2-2^3 U, (A. 18) 



where Vi , V2 , V3 are defined in ( |A.16| ). 

Proof: Consider Hu, H22, H12, H21 € C and 
^1) ^2, V3 as defined in ( A.16 1. Without loss of general- 
ity, we can write: 

i^iii^22 = A + Bi 
H12H21 =C + Di, 

A,B,C,D G TZ. Using the above definitions we get: 
2^1 = 2 • U{e{HnH22H^2H2i} = 2{AC + BD). Also 
note that: A^ + C'^ > 2AC for all A, C G 7^. Thus 



ITJ- \2\ TT \2 I \ TT |2| 

l-nill |-n22| + \n-12\ \ 



H2i\^ > 2-^t{HnH22Hl^H*,} 
= 2Vi. 



Repeating this argument for V2 and V3, we conclude 
that the multiplier of (P1P2 - 2|ai2p) in \A.\1\ is 



non-negative and omitting 2|ai2p from ( |A. 17 i does 



not reduce the expected value. This leads to ( |A.18 1. 
Also note that since log(x) monotonically increases with 
respect to x, then (|A.18|) is maximized when Txi and 



Tx2 transmit at their maximum available power. 



Hence, ( |A.18 1 can be obtained with equality from 
( A.13| ) by setting ai2 = ais = 023 = 0. We conclude 
that the mutual information expressions in the cut-set 
bound are maximized by zero-mean, complex Normal 
channel inputs independent of each other, and with all 
sources transmitting at their maximum available power. 

Appendix B 
The Capacity Region of the EMARC 

The capacity of the EMARC is stated in the following 
theorem: 

Theorem B.l. Consider the fading EMARC with Rx-CSI 
derived from the ICRF, given by equations ([T} where its 
message destination is Rxi but the relay receives feed- 
back from both receivers s.t. y\~i ,y2~i ,h\^i and h'^2'1 
are available at the relay at time i, prior to transmission. 
Assume that the channel coefficients are independent in 
time and independent of each other s.t. their phases 
are i.i.d. and distributed uniformly over [0, 27r). Let the 
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additive noises be i.i.d. circularly symmetric complex 
Normal processes, CA/'(0, 1), and let the sources have 
power constraints E||X,fcp} < P^, k G {1,2,3}. The 
capacity region is then given by all nonnegative rate 
pairs s.t. 

Ri < mm{I{Xi;Yi,Y2,Ys\X2,Xs,H), 

I{Xi,X3;Yi\X2,Hi)}{BAsi) 

R2 < mm{IiX2;Yi,Y2,Y3\Xi,X3,H), 

IiX2,X3;Yi\Xi,Hi)} (B.lb) 

Ri + R2< mm{I{Xi,X2;Yi,Y2,Y3\X3,H), 

IiXi,X2,X3;Yi\Hi)}, (B.lc) 

and it is achieved with X^ ~ CM{0, Pk), k G {1, 2, 3}, 
mutually independent and with DF strategy at the relay. 

Proof: The proof consists of the following steps: 

• We provide an outer bound on the capacity region 
using the cut-set bound. 

• We show that the input distribution that maximizes 
the outer bound is zero-mean, circularly symmetric 
complex Normal with channel inputs independent 
of each other and with maximum allowed power. 

• Assuming codebooks generated according to the 
maximizing distribution, we present an achievable 
rate region using the DF strategy at the relay: 

- For decoding at the relay, we follow steps 
similar to \1 . Sec. 4.D]. 

- We provide an achievable rate region for de- 
coding at the destination by considering a back- 
ward decoding scheme. 

• We conclude that the intersection of the achievable 
rate regions for decoding at the relay and at the 
destination coincides with the cut-set bound. 

A. An Outer Bound 

The following bounds are the cut-set bounds of the 
EM ARC rate region: 

S = {Txi},cS^ ^ {Tx2, Relay, Rxi,Rx2} : 

Ri < I{Xr,Yi,Y2,Y3\X2,X3,H) (B.2a) 
S = {Txi,Relay,Rx2},5^ = {Tx2,Rxi} : 

Ri<I{Xi,Xs;Yi\X2,Hi) (B.2b) 
S = {Tx2},cS^ = {Txi, Relay, Rxi,Rx2} : 

R2 < I{X2;Y^,Y2,Y:,\Xi,X3,H) (B.2c) 
S = {Tx2,Relay,Rxi},5^ ^ {Txi,Rx2} : 

R2<I{X2,Xs;Yi\Xi,H2) (B.2d) 
S = {Txi,Tx2},cS^ = {Rxi,Rx2, Relay} : 

Ri + R2 < I{Xi,X2;Yi,Y2,Ys\Xs,H)(B.2e) 



Following the same arguments as in sections |A-A[ |A-B 



and |A-C| we conclude that the outer bounds on Ri and 
R2 are maximized by mutually independent, zero-mean, 
circularly symmetric complex Normal channel inputs 
and with all sources transmitting at their maximum 
available power. Moreover, we obtain an upper bound 
on I{Xi,X2,Xs;Yi\Hiy. 

I{Xi,X2,Xr,Yi\Hi) 

< E^^|log2 (l + |i/ii|2Pi + |i/2l|'i'2 + |^3l|'i^3)jO-3) 

and we conclude that it is achieved by mutually indepen- 
dent, zero mean, circularly symmetric complex Normal 
channel inputs. 

B. An Achievable Rate Region 

The achievability is based on DF strategy at the 
relay. Fix the block length n and the input distri- 
butions: fx^xi), fx2{x2), fxsixs) where fxAxk) ~ 
CJ\f{0, Pk),k G {1,2,3}. The following encoding and 
decoding methods are considered: 

1 ) Code Construction: The code construction is sim- 
ilar to section IIV-A2al 

2) Encoding at Block b: The encoding process is 
similar to section IIV-A2b[ 

3) Decoding at the Relay at Block b: The decoding 



S = {Txi,Tx2, Relay, Rx2},cS^ = {Rxi} : 
Ri + R2<I{Xi,X2,Xs;Yi\H). 



(B.2f) 



process at the relay is similar to Section IV-A2c leading 
to the rate constraints (|7]). 

4) Decoding at the Destination: The receiver uses 
a backward block decoding method. Assume that the 
receiver has successfully decoded rrii^b+i and m2,b+i. 
Then 

• In the first step the receiver generates the sets: 

So,b = \^{rni,m2) G Mi x M2 ■ (xi(mi,b+i), 
X2(m2,b+i),X3(mi,m2),yi(5 + l),hi(6 + l))G4"^}. 
£i,b = [{rni,m2) £ Mi x M2 ■ (xi(mi), 

X2(m2),yi(6),hi(6)) G^'^)}. 

• The receiver then decodes {mi^b, ^2,b) by finding 
a unique pair (mi, 7712) G So^b H Si^b- 

Let the decoded pair be (mi {,,m2,fe). A decoding error 
happens if one of the following error events, associated 
with the decoding rule at the destination occurs: 

• Eo b U Ei^b> where 

Eo,b = |(xi(mi,fc+i),X2(m2,6+i),X3(mi,fe,m2,6), 

yi(6+l),hi(6+l)) ^4")} 
Ei^b = {(xi(mi,fe),X2(m2,b),yi(6),hi(6)) ^ 4")}. 
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From joint-typicality, the probability of the above 
event can be arbitrarily small if n is large enough. 

• -^2,6 = {{rhifi ^ mi^b,m2,b) G So,b n<Si,b}. From 
||6j Lemma 2]: 

Pr{(mi^b / mi^b,m2,b) S £^0,6} 

^ 2-n{I{X,;Y,\XuX2,Hi)-7e) 
2-'^{'f('^i;^il^2,i?i)-7e)^ 

Note that since the codebooks are constructed in- 
dependent of each other then <So,6 is independent of 
Si^b and the probability of i?2,b can be arbitrarily 
small if n is large enough and 

Ri < IiX3;Yi\Xi,X2,Hi)+I{Xi;Yi\X2,Hi) 
= IiXi,X3;Yi\X2,Hi). (B.4a) 

• -^3,6 = {{mi^b,'m2,b / rn2,b) G £o,b<^£i,b}- From 
||6l Lemma 2], the probability of this event can be 
arbitrarily small if n is large enough and 

R2<I{X2,X3;Yi\Xi,Hi). (B.4b) 

• -^4,6 = / rni^b,m2,b / "i2,6) G <?o,bn<?i,fe}. 
From ||6l Lemma 2]: 

Pr{(mi_;, / mi,fc,m2,6 / "^2,6) G <?o,6} 

^ 2-"('f(^3;^i|Xi,X2,i?i)-7£) 

Pr{(mi,;, ^ mi^b,in2,b / ^-2,5) G Si^b} 

^ 2-"('f(^i.^2;Yi|i?i)-7e) 

the probability of this event can be arbitrarily small 
if n is large enough and 

Ri + R2< I{X^;Yi\Xi,X2,Hi) + I{Xi,X2;Yi\Hi) 
= I{Xi,X2,X3;Yi\Hi). (B.4c) 

Combining ^ and ( B.4 i, we obtain the achievable rate 
region of the EM ARC: 

'^EMARC 

{Ri,R2)ed\l : 



R, <mm{l{Xv,Yi,Y2,Y3\X2,Xs,H), 

I{Xi,Xs;Yi\X2,Hi)} (B.5a) 

R2<mm{l{X2;Yi,Y2,Ys\X2,X^,H), 

I{X2,X3;Yi\Xi,Hi)} (B.5b) 

Ri + R2<mm{l{Xi,X2;Yi,Y2,Y3\X3,H:}, 

I{Xi,X2,X3;Yi\Hi)}]. (B.5c) 



Appendix C 
Proof of Proposition [3] 

Inner bound: : Note that the region TiYcRF 
can be obtained by time-sharing between two rate 
points: point A is the rate pair {Ri,a,R2,a) = 
{l{X,,Xs;Yi\X2,Hi),I{X2,Xs;Y2\X,,H2)), ' 
and point B is the rate pair {Ri,b,R2,b) = 
{l{Xi,X2,X3;Yi\Hi),0). Theorem 1 shows that 
in the VSI regime {Ri^a, R2,a) is achievable. We next 
show that {Ri.b,R2,b) is achievable. This is done 
using the DF-based achievability scheme described in 
the following: 

Fix the blocklength n and the input distribution 

fXuX2,xAxi,X2,X3) = fx.ixi) • fx2{x2) ' fx^X^) 

where Xu ~ C7\A(0,Pfc) k G {1,2,3}. Note that as 
R2 = 0, then Tx2 acts as a second relay for sending 
nil from Txi to Rxi. We use nB channel symbols for 
sending B — 1 messages. 

a) Codebook Construction: For each mi G A^i 
and k G {1,2,3}, select a codeword Xfc(mi) according 
to the p.d.f. /x, (xfc(mi)) = HILi fx^ [xkA'^i))- 

b) Encoding at Block b: At block b, Txi transmits 
mi b using xi{nii b)- Let w-i mi denote the de- 
coded mi 5_i at the end of block 6—1, at the relay and at 
Tx2, respectively. At block b, Tx2 transmits X2(mi b_i) 
and the relay transmits X3(mi ;,_i). At block 6 = 1, Tx2 
transmits X2(l), and the relay transmits X3(l), and at 
block b = B, Txi transmits xi(l). 

c) Decoding at the Relay and at Tx2 at Block b: 
The relay and Tx2 each uses a joint-typicality decoder. 
We now find conditions for bounding the average proba- 
bility of error averaged over all codebooks. The decoder 
at the relay looks for a unique mi G A^i which satisfies 



XI (mi ) , X2 (mi,6_ 1 ) , X3 (mi,6_i ) , y 1 (6) , y2 (6) , 
ys (6) , h(6)) G A^^ {Xi,X2,Xs,Yi,Y2,Ys,H). 



We conclude that the relay can decode mi 5 with an 
arbitrarily small probability of error if n is large enough 
and 

Ri < I{Xi;Yi,Y2,Y3\X2,Xs,H). (C.la) 

Following the same approach, we can show that Tx2 can 
decode mi ^ reliably if n is large enough and 



iil </(Xi;y2|^2,X3,^2). 



(C.lb) 



Finally, note that ( B.5[ ) coincides with the cut-set bound 
in ( |B.2| ) and thus it is the capacity region of the EMARC. 



Note that as /(Xi;yi,y2,il!|^2,^3,l) > 
I{Xi;Y2\X2, X3, Hi), then reliable decoding at 
Tx2 guarantees reliable decoding at the relay. 
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d) Decoding at the Destination: Rxi uses a back- 
ward decoding scheme based on a joint-typicality rule. 
Assume that Rxi correctly decoded mi 5+1. Then 

• Rxi generates the sets: 

"^^0,6 - I^T-i G Ml : (xi(mi,fe+i),X2(mi),X3(mi), 
yi(6+l),hi(6+l)) G^'^)} 
8i,b ^ {mi G Ml : (xi(mi),yi(6),hi(6)) E 4")}. 

• Rxi then decodes mi^f, by finding a unique mi G 

£o,b n £i^h- 

Note that since the codewords are independent of each 
other, ^0,6 is independent of <Si j, and the probability of 
decoding error can be made arbitrarily small by taking 
n large enough as long as 

Ri < I{X2,X3;Yi\Xi,Hi) + I{Xi;Yi\Hi) 

= I{Xi,X2,X3;Yi\Hi). (C.2) 



outputs and the Rx-CSI, to both transmitters. Clearly, the 
capacity region of this channel constitutes an outer bound 
on CicRF- In the following we show that this capacity 



Note that since (38 1 holds then \C1\ guarantees 



( |C.lb[ ). Therefore reliable decoding at Rxi implies re- 
liable decoding at Tx2, and thus reliable decoding 



at the relay. Hence, when ( [381 ) holds the rate pair 

{Ri,b,R2,b) = {l{Xi,X2,X3;Yi\Hi),0) is achiev- 
able. 

By time sharing between point A and point B we 
conclude that the inner bound T^YcRF i^ achievable. 

Outer bound: Consider the following three modifi- 
cations to the ICR scenario defined in the proposition: 
(Ml) We let each receiver observe the instantaneous 
channel output and Rx-CSI at the relay, [y3,i,h{i)^, and 
at the other receiver; (M2) We also let each receiver send 
a feedback signal which consists of its channel output 
and Rx-CSI, to the opposite transmitter (in addition to 
the corresponding transmitter); and (M3) We let the 
relay send causal feedback of its channel output and Rx- 
CSI to both transmitters. Under these three assumptions, 
each receiver observes the same channel output at time 
h {yi,i,y2,i,y3,i,h.{i)), and each transmitter observes at 
time i the feedback (yi^j_i, y2,j-i> y3,j-i> — 1))- Due 
to (Ml) and the data processing inequahty, the relay 
does not need to send any channel input, and we can 
set Xs = 0. Equivalently, we may assume that the relay 
channel input is available non-causally at the receivers 
and therefore they can subtract it from their received 
signal prior to decoding and to sending feedback (as the 
receivers know at time i y^^i and the CSI at the relay, 
and as they know the encoding function at the relay, 
they can generate at time i x^^i). The resulting scenario 
is therefore equivalent to the fading vector MAC with a 
MIMO receiver and causal feedback, of both the channel 



region is given by Cmac~fb defined in (|36]l. 

To show this, we first derive an outer bound on the 
capacity region of the fading vector Gaussian MAC 
with feedback and Rx-CSI, denoted Cmac-fb- This 
outer bound can be obtained from the cut-set bound ||39l 
Theorem 15.10.1] (see also ll50l ). and is given by 

Cmac-fb^ [J T^MAc-FB{f{xi,X2)), 
where 

TlMAC-FB{f{xi,X2)) 

{Ri,R2)e^l : 

Ri<IiXi;Yi,Y2,Y3\X2,Xs = 0,B) (C.3a) 
R2 < IiX2;Yi,Y2,Ys\Xi,X3 = 0,H) (C.3b) 

R1+R2 < I{Xi,X2;Yi,Y2,Y3\X3 = 0, H)] ,(C.3c) 



where all mutual information expressions are evaluated 
with the specified input distribution /(a^i, X2). Repeating 
the arguments in Appendix |A] we conclude that the 
mutual information expressions in Eqns. ( |C.3| ) are simul- 
taneously maximized by mutually independent channel 
inputs Xk ~ CAf{0,Pk), k = 1,2. Denote the cor- 
responding input distributions g{xk), k = 1,2. Thus 
Cmac-fb Q T^MAc-FB{g{xi)g{x2)). 

It is straightforward to conclude that when X^ ~ 
CJ\f{0,Pk), k = 1,2, mutually independent, then 
any rate pair in TlMAC-FB{g{xi)g{x2)) is achiev- 
able. Thus Cmac-fb 5 TlMAC-FB{g{xi)g{x2)). 
Combined with the outer bound we conclude that 
Cmac-fb = T^MAC-FB{g{xi)g{x2)). Lastly, we note 
that letting X3 ~ CM^O^Ps) independent of Xi, X2 
does not change the rate expressions, thus Cmac-fb = 
Cmac-fb- 

Next, consider TZqb- The derivation of the rate con- 
straints in TZq b uses similar steps as in the derivation of 
the constraints in the cut-set bound, with the exception 
that the individual rate constraints are derived while 
letting both YJ^^ and Y^2 available at each receiver 
for decoding. This is necessary in order to accommodate 



the feedback, see Comment 22 Similarly to Appendix 
[a] it can be shown that mutually independent Gaussian 
inputs simultaneously maximize the mutual information 
expressions on the right-hand side of all constraints in 
( |37] ). Note that the sum-rate is maximized by mutually 
independent Gaussian inputs as a consequence of 
Theorem 8]. 
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This completes the proof of the outer bound on Cjcrf- 
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